Nov 02 17:39:12.862139 ip-10-0-132-5 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 17:39:13.283413 ip-10-0-132-5 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:13.283413 ip-10-0-132-5 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 17:39:13.283413 ip-10-0-132-5 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:13.283413 ip-10-0-132-5 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:13.286783 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286698    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.286783 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286782    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.286783 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286786    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286789    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286793    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286796    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286799    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286802    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286805    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286807    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286810    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286813    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286816    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286819    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286822    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286830    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286833    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286836    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286839    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286842    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286844    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286847    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.286890 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286849    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286852    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286855    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286869    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286872    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286875    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286877    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286880    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286883    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286885    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286888    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286891    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286894    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286896    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286899    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286903    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286908    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286910    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286913    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.287353 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286916    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286918    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286921    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286924    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286928    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286932    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286935    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286939    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286941    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286944    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286946    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286949    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286952    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286955    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286958    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286961    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286963    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286966    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.287798 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286969    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286972    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286974    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286977    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286980    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286982    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286985    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286987    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286990    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286992    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286995    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.286997    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287000    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287002    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287005    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287007    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287010    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287012    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287015    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287017    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.288234 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287020    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287022    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287026    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287028    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287031    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287033    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287036    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287038    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287041    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287043    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287046    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287049    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287051    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287054    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287058    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287060    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287063    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287065    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287068    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287070    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.288692 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287073    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287075    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287078    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287080    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287083    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287085    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287088    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287880    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287887    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287890    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287893    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287896    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287898    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287901    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287904    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287908    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287910    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287913    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287916    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.289220 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287919    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287921    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287925    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287927    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287930    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287933    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287935    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287938    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287941    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287944    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287946    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287949    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287951    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287954    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287957    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287959    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287962    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287966    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287970    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.289673 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287973    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287976    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287979    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287982    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287984    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287987    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287990    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287992    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287995    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.287997    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288000    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288003    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288005    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288008    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288012    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288015    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288018    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288023    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288026    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288029    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.290140 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288032    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288035    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288038    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288040    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288043    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288046    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288049    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288052    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288055    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288057    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288060    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288062    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288065    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288067    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288070    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288073    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288075    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288078    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288081    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.290897 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288083    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288086    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288089    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288091    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288094    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288097    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288100    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288103    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288106    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288108    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288111    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288114    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288116    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288119    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288121    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288124    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288127    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288129    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288132    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288135    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.291443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288138    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288140    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288143    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288145    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288148    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288150    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288153    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288155    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288158    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288160    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288163    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288166    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288168    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288171    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288174    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288176    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288647    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288652    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288655    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.291935 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288657    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288660    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288663    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288665    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288668    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288671    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288673    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288676    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288679    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288682    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288684    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288687    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288690    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288692    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288695    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288698    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288702    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288704    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288709    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.292398 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288712    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288715    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288718    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288720    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288723    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288726    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288728    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288731    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288734    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288736    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288739    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288746    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288749    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288751    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288754    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288756    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288759    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288762    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288764    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.292849 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288767    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288769    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288772    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288775    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288777    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288780    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288782    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288785    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288788    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288790    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288793    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288796    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288798    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288801    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288804    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288806    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288809    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288811    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288816    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.293344 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288819    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288822    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288825    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288827    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288830    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288833    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288836    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288838    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288841    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288843    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288846    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288848    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288851    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288853    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288869    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288872    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288875    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288878    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288880    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288883    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.293898 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288885    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288888    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288891    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288896    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288898    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288901    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288904    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288906    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288909    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288911    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288914    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288917    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288919    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288922    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288926    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288928    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288931    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288934    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288936    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288939    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.294376 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288942    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288944    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288947    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288950    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288952    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.288954    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.289993    2583 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290006    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290012    2583 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290017    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290021    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290025    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290029    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290033    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290037    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290040    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290044    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290047    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290050    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290053    2583 flags.go:64] FLAG: --cgroup-root=""
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290056    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290059    2583 flags.go:64] FLAG: --client-ca-file=""
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290064    2583 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 17:39:13.294911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290067    2583 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290072    2583 flags.go:64] FLAG: --cluster-domain=""
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290075    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290078    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290082    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290085    2583 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290089    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290092    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290095    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290133    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290171    2583 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290226    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290257    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290265    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290272    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290299    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290305    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290310    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290316    2583 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290328    2583 flags.go:64] FLAG: --enable-server="true"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290333    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290343    2583 flags.go:64] FLAG: --event-burst="100"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290349    2583 flags.go:64] FLAG: --event-qps="50"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290354    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 17:39:13.295441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290359    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290364    2583 flags.go:64] FLAG: --eviction-hard=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290371    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290376    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290386    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290393    2583 flags.go:64] FLAG: --eviction-soft=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290398    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290402    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290407    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290413    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290417    2583 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290422    2583 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290432    2583 flags.go:64] FLAG: --feature-gates=""
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290438    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290444    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290450    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290455    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290461    2583 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290466    2583 flags.go:64] FLAG: --help="false"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290471    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290483    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290488    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290493    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 17:39:13.296064 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290501    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290507    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290512    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290517    2583 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290522    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290527    2583 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290536    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290541    2583 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290546    2583 flags.go:64] FLAG: --kube-reserved=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290551    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290555    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290560    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290565    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290570    2583 flags.go:64] FLAG: --lock-file=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290575    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290585    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290590    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290599    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290604    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290609    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290614    2583 flags.go:64] FLAG: --logging-format="text"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290619    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290625    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290634    2583 flags.go:64] FLAG: --manifest-url=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290639    2583 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 17:39:13.296612 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290647    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290652    2583 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290659    2583 flags.go:64] FLAG: --max-pods="110"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290664    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290669    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290675    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290685    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290690    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290695    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290700    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290713    2583 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290719    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290724    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290740    2583 flags.go:64] FLAG: --pod-cidr=""
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290746    2583 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290751    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290756    2583 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290761    2583 flags.go:64] FLAG: --port="10250"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290766    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290771    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0e561b5ed6c4a67d9"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290777    2583 flags.go:64] FLAG: --qos-reserved=""
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290782    2583 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290792    2583 flags.go:64] FLAG: --register-node="true"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290796    2583 flags.go:64] FLAG: --register-with-taints=""
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290803    2583 flags.go:64] FLAG: --registry-burst="10"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290807    2583 flags.go:64] FLAG: --registry-qps="5"
Nov 02 17:39:13.297245 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290813    2583 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290818    2583 flags.go:64] FLAG: --reserved-memory=""
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290824    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290830    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290840    2583 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290844    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290850    2583 flags.go:64] FLAG: --runonce="false"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290855    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290876    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290881    2583 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290888    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290893    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290900    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290910    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290915    2583 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290920    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290925    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290930    2583 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290935    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290940    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290945    2583 flags.go:64] FLAG: --system-cgroups=""
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290950    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290965    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290970    2583 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290975    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 17:39:13.297871 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290982    2583 flags.go:64] FLAG: --tls-min-version=""
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290987    2583 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.290992    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291002    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291007    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291012    2583 flags.go:64] FLAG: --v="2"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291019    2583 flags.go:64] FLAG: --version="false"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291025    2583 flags.go:64] FLAG: --vmodule=""
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291076    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291097    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291384    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291394    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291397    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291400    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291404    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291407    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291410    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291412    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291415    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291418    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291421    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291424    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.298474 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291426    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291429    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291432    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291435    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291437    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291440    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291442    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291445    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291449    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291451    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291454    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291457    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291460    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291462    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291465    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291467    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291471    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291473    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291476    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291479    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.299016 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291481    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291484    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291486    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291489    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291492    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291494    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291496    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291499    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291502    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291505    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291507    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291510    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291513    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291515    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291518    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291520    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291523    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291525    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291528    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291531    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.299521 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291534    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291536    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291539    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291541    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291544    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291546    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291549    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291551    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291554    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291556    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291559    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291562    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291565    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291568    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291570    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291573    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291576    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291579    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291582    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.300014 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291584    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291588    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291592    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291595    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291598    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291600    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291603    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291606    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291608    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291611    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291613    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291616    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291618    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291621    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291623    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291626    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291629    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291631    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.300454 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291634    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291636    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291640    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291642    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291645    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291647    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291650    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291653    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291655    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291659    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291665    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291668    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291671    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291674    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291676    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291679    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.300949 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291682    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.291710    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291749    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291754    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291757    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291760    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291763    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291765    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291768    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291771    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291773    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291776    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291778    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291781    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291784    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.301320 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291786    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291789    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291791    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291794    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291797    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291799    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291802    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291806    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291810    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291813    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291816    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291819    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291822    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291824    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291827    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291830    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291832    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291835    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291837    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291840    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.301678 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291843    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291845    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291848    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291850    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291853    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291869    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291872    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291874    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291878    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291881    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291884    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291887    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291889    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291892    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291895    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291897    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291900    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291903    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291906    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291908    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.302163 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291911    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291913    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291916    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291920    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291923    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291925    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291928    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291930    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291933    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291936    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291939    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291942    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291945    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291948    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291950    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291953    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291956    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291959    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291961    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291964    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.302631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291968    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291971    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291973    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291976    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291979    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291982    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291985    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291987    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291989    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291992    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291995    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.291998    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292000    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292003    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292005    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292010    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292012    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292015    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292018    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.303120 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292020    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292023    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292026    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292028    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292031    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292034    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292036    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292039    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292043    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292047    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292049    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292052    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292055    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.292060    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.298492    2583 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.298508    2583 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.298522    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.298527    2583 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298597    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.304443 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298601    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298605    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298609    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298612    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298614    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298617    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298620    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298623    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298626    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298628    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298631    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298633    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298636    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298639    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298642    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298644    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298647    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298650    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298652    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298655    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.305008 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298658    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298660    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298663    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298665    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298668    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298671    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298673    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298676    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298680    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298683    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298686    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298689    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298692    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298694    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298697    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298701    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298704    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298707    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298710    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.305486 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298712    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298715    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298717    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298720    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298723    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298725    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298728    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298731    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298742    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298745    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298748    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298750    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298753    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298755    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298758    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298761    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298763    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298766    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298768    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.305968 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298771    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298774    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298778    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298781    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298784    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298787    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298789    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298792    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298794    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298797    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298800    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298802    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298805    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298808    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298810    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298813    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298815    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298818    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298821    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298823    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.306457 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298826    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298828    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298831    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298834    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298836    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298839    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298841    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298844    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298847    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298849    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298852    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298854    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298872    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298875    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298878    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298881    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298884    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298888    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298891    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298893    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298896    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.307037 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298898    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298901    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298904    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298908    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298912    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.298915    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.298942    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299108    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299112    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299115    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299119    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299123    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299125    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299129    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299132    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299134    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.307525 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299137    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299140    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299143    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299146    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299148    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299151    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299153    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299156    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299159    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299161    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299164    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299167    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299170    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299174    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299176    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299178    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299181    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299184    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299187    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.307913 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299191    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299194    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299197    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299200    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299202    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299205    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299207    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299210    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299213    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299215    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299218    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299220    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299223    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299225    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299228    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299231    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299233    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299236    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299238    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.308355 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299241    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299243    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299246    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299248    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299251    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299254    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299256    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299259    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299262    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299264    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299267    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299270    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299272    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299275    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299277    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299279    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299282    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299284    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299290    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299292    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.308810 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299295    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299297    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299299    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299302    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299304    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299307    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299310    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299312    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299314    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299317    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299320    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299322    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299324    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299327    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299329    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299332    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299334    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299337    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299339    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299342    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.309379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299345    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299349    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299353    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299355    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299358    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299360    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299363    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299366    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299368    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299371    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299374    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299377    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299380    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299382    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299385    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299387    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299390    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299392    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.309848 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299395    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.299418    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299453    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299457    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299460    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299464    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299466    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299469    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299472    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299474    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299477    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299480    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299482    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299485    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299487    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299490    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:13.310301 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299493    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299496    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299498    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299501    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299503    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299506    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299508    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299511    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299515    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299518    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299521    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299523    2583 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299526    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299529    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299534    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299538    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299541    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299544    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299547    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:13.310675 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299549    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299552    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299554    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299557    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299559    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299562    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299565    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299567    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299570    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299572    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299575    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299578    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299580    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299584    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299586    2583 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299589    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299591    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299594    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299596    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:13.311146 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299599    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299601    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299604    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299607    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299609    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299612    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299614    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299617    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299619    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299622    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299624    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299626    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299629    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299632    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299634    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299637    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299640    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299642    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299645    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299647    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:13.311681 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299649    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299652    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299654    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299657    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299660    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299662    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299664    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299667    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299670    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299672    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299675    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299677    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299679    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299682    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299685    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299687    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299690    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299694    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299697    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:13.312165 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299699    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299702    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299704    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299706    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299709    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299712    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299714    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299717    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299719    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299723    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299725    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299728    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299730    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299733    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:13.299735    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.299791    2583 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.302113    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.303097    2583 server.go:1014] "Starting client certificate rotation"
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.303197    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 17:39:13.312830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.304013    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 17:39:13.313496 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.305146    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 17:39:13.313496 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.306379    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 17:39:13.324009 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.323984    2583 log.go:25] "Validated CRI v1 runtime API"
Nov 02 17:39:13.327224 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.327208    2583 log.go:25] "Validated CRI v1 image API"
Nov 02 17:39:13.328030 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.328006    2583 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 17:39:13.331768 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.331746    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81792f29-8c4b-4f46-a876-6e2912bdf72f:/dev/nvme0n1p3 86bef26d-33d6-41a3-9e10-2a214a5fb62f:/dev/nvme0n1p4]
Nov 02 17:39:13.331841 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.331766    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 02 17:39:13.336173 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.336055    2583 manager.go:217] Machine: {Timestamp:2026-11-02 17:39:13.335299575 +0000 UTC m=+0.349549651 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100739 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e8d149d8a92f32668b4f5e1bcd49 SystemUUID:ec26e8d1-49d8-a92f-3266-8b4f5e1bcd49 BootID:8cac69c5-2ba7-413a-8d13-2a10b782cdd0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c4:79:a8:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c4:79:a8:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:74:de:f5:9d:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 17:39:13.336173 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.336166    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 17:39:13.336274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.336240    2583 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 17:39:13.337362 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.337336    2583 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 17:39:13.337495 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.337364    2583 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-5.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 17:39:13.337537 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.337497    2583 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 17:39:13.337537 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.337505    2583 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 17:39:13.337537 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.337528    2583 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 17:39:13.338367 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.338347    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 17:39:13.339182 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.339160    2583 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 17:39:13.339319 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.339303    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 17:39:13.342834 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.342822    2583 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 17:39:13.342959 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.342950    2583 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 17:39:13.343001 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.342980    2583 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 17:39:13.343001 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.342990    2583 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 17:39:13.343001 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.343001    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 17:39:13.343123 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.343015    2583 kubelet.go:405] "Adding apiserver pod source"
Nov 02 17:39:13.343123 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.343025    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 17:39:13.343429 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.343417    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 17:39:13.346250 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.346234    2583 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 17:39:13.351502 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.351489    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 17:39:13.352389 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352378    2583 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 17:39:13.352429 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352407    2583 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 17:39:13.352561 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352551    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 17:39:13.352591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352567    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 17:39:13.352591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352573    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 17:39:13.352591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352579    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 17:39:13.352591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352584    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 17:39:13.352591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.352592    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 17:39:13.353224 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353216    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 17:39:13.353254 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353224    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 17:39:13.353254 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353232    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 17:39:13.353254 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353238    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 17:39:13.353254 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353253    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 17:39:13.353373 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.353262    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 17:39:13.354783 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.354769    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 17:39:13.354821 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.354788    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 17:39:13.359474 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.359457    2583 server.go:1263] "Started kubelet"
Nov 02 17:39:13.359615 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.359563    2583 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 17:39:13.359766 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.359568    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 17:39:13.359845 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.359786    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 17:39:13.360130 ip-10-0-132-5 systemd[1]: Started Kubernetes Kubelet.
Nov 02 17:39:13.361526 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.361504    2583 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 17:39:13.362197 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.362177    2583 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 17:39:13.365508 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.365463    2583 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 02 17:39:13.368940 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.368927    2583 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 17:39:13.368996 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.368943    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 17:39:13.369044 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.369025    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.369629 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369614    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 17:39:13.369763 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369617    2583 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 17:39:13.369844 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369765    2583 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 17:39:13.369844 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369669    2583 factory.go:55] Registering systemd factory
Nov 02 17:39:13.369844 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369838    2583 factory.go:223] Registration of the systemd container factory successfully
Nov 02 17:39:13.370013 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369973    2583 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 17:39:13.370013 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.369988    2583 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 17:39:13.370103 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.370066    2583 factory.go:153] Registering CRI-O factory
Nov 02 17:39:13.370103 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.370081    2583 factory.go:223] Registration of the crio container factory successfully
Nov 02 17:39:13.370195 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.370129    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 17:39:13.370195 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.370148    2583 factory.go:103] Registering Raw factory
Nov 02 17:39:13.370195 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.370162    2583 manager.go:1199] Started watching for new ooms in manager
Nov 02 17:39:13.371077 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.371062    2583 manager.go:319] Starting recovery of all containers
Nov 02 17:39:13.377292 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.377242    2583 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-5.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 02 17:39:13.377608 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.377589    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-5.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 02 17:39:13.378363 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.378156    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 02 17:39:13.381223 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.377320    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-5.us-east-2.compute.internal.18e44b203882ac5c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-5.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-5.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 17:39:13.359424604 +0000 UTC m=+0.373674679,LastTimestamp:2026-11-02 17:39:13.359424604 +0000 UTC m=+0.373674679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-5.us-east-2.compute.internal,}"
Nov 02 17:39:13.382180 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.382145    2583 manager.go:324] Recovery completed
Nov 02 17:39:13.383259 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.383232    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-5.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 02 17:39:13.383871 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.383834    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 02 17:39:13.389013 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.389001    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.391044 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391029    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.391098 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391060    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.391098 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391072    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.391582 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391568    2583 cpu_manager.go:226] "Starting" policy="none"
Nov 02 17:39:13.391582 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391580    2583 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 17:39:13.391673 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391596    2583 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 17:39:13.391673 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.391630    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.392350 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.392335    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.392402 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.392360    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.392402 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.392370    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.393480 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.393393    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-5.us-east-2.compute.internal.18e44b203a652afd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-5.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-5.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-5.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 17:39:13.391045373 +0000 UTC m=+0.405295448,LastTimestamp:2026-11-02 17:39:13.391045373 +0000 UTC m=+0.405295448,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-5.us-east-2.compute.internal,}"
Nov 02 17:39:13.393843 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.393831    2583 policy_none.go:50] "Start"
Nov 02 17:39:13.393907 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.393847    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 17:39:13.393907 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.393870    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 17:39:13.395941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.395925    2583 policy_none.go:44] "Start"
Nov 02 17:39:13.398299 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.398282    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbhzr"
Nov 02 17:39:13.400547 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.400468    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-5.us-east-2.compute.internal.18e44b203a657d65  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-5.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-5.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-5.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 17:39:13.391066469 +0000 UTC m=+0.405316545,LastTimestamp:2026-11-02 17:39:13.391066469 +0000 UTC m=+0.405316545,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-5.us-east-2.compute.internal,}"
Nov 02 17:39:13.403080 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.403023    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-5.us-east-2.compute.internal.18e44b203a65a5e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-5.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-5.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-5.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 17:39:13.391076835 +0000 UTC m=+0.405326910,LastTimestamp:2026-11-02 17:39:13.391076835 +0000 UTC m=+0.405326910,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-5.us-east-2.compute.internal,}"
Nov 02 17:39:13.407715 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.407695    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbhzr"
Nov 02 17:39:13.415502 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.415292    2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-5.us-east-2.compute.internal.18e44b203a652afd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-5.us-east-2.compute.internal.18e44b203a652afd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-5.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-5.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-5.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 17:39:13.391045373 +0000 UTC m=+0.405295448,LastTimestamp:2026-11-02 17:39:13.392348166 +0000 UTC m=+0.406598241,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-5.us-east-2.compute.internal,}"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.426433    2583 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.430684    2583 manager.go:341] "Starting Device Plugin manager"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.430714    2583 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.430725    2583 server.go:87] "Starting device plugin registration server"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.431005    2583 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.431018    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.431082    2583 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.431148    2583 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.431154    2583 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.432851    2583 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.432913    2583 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.439657    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.440814    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.440832    2583 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.440850    2583 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.440893    2583 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 02 17:39:13.449499 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.444584    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:13.531253 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.531220    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.532234 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.532208    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.532333 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.532241    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.532333 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.532252    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.532333 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.532276    2583 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.540205 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.540156    2583 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.540205 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.540178    2583 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-5.us-east-2.compute.internal\": node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.541212 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.541192    2583 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"]
Nov 02 17:39:13.541280 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.541250    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.543957 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.543941    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.544039 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.543972    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.544039 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.543985    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.546085 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.546073    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.546257 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.546241    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.546305 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.546273    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.547332 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547315    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.547403 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547340    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.547403 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547353    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.547465 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547400    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.547465 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547425    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.547465 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.547435    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.549489 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.549472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.549566 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.549496    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:13.550126 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.550111    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:13.550203 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.550134    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:13.550203 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.550143    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:13.571919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.571900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.571987 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.571925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.571987 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.571944    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.590407 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.590392    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.591613 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.591597    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.593185 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.593170    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672065 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672123    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672140    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.672196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.672152    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.692311 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.692292    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.792907 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.792839    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.893660 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.893623    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:13.893660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.893648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.896680 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:13.896668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:13.994730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:13.994698    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:14.095257 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:14.095170    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:15.743715 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:15.743693    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:15.844220 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:15.844176    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:15.851354 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:15.851336    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 02 17:39:15.851512 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:15.851492    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 17:39:15.944627 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:15.944566    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:15.960105 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:15.960078    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 17:34:14 +0000 UTC" deadline="2028-05-21 12:27:46.396551869 +0000 UTC"
Nov 02 17:39:15.960105 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:15.960103    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13578h48m30.436452239s"
Nov 02 17:39:16.044899 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.044876    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:16.080807 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.080781    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:16.082850 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.082821    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:16.082967 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.082870    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:16.082967 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.082884    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:16.145012 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.144977    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:16.198233 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:16.198160    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23d73ef12b6a83fae531e9ed10d8052.slice/crio-34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7 WatchSource:0}: Error finding container 34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7: Status 404 returned error can't find the container with id 34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7
Nov 02 17:39:16.198614 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:16.198596    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3c8112ada91bb137b5c031fc287485.slice/crio-a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c WatchSource:0}: Error finding container a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c: Status 404 returned error can't find the container with id a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c
Nov 02 17:39:16.203549 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.203532    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 17:39:16.245420 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.245391    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:16.267714 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.267690    2583 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:16.345905 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.345865    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:16.446655 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.446630    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:16.513432 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.513381    2583 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:16.535010 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.534987    2583 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:16.618032 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.618000    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:16.631164 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.631136    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:16.632390 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.632368    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:16.651272 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.651249    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:16.892916 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.892699    2583 apiserver.go:52] "Watching apiserver"
Nov 02 17:39:16.903279 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.903252    2583 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 17:39:16.903710 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.903677    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dk9mr","openshift-network-operator/iptables-alerter-8cp4n","kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal","openshift-dns/node-resolver-b5tc5","openshift-image-registry/node-ca-fqvxr","openshift-network-diagnostics/network-check-target-9b9vg","kube-system/global-pull-secret-syncer-fmrts","kube-system/konnectivity-agent-9h65q","openshift-multus/multus-fhdv5","openshift-multus/network-metrics-daemon-rn4m9","openshift-ovn-kubernetes/ovnkube-node-mpwgj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt","openshift-cluster-node-tuning-operator/tuned-vkzt5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"]
Nov 02 17:39:16.906423 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.906397    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:16.906538 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.906484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:16.908654 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.908627    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.911575 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.910869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:16.913714 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.912428    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zpgl9\""
Nov 02 17:39:16.913714 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.912595    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:16.913714 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.912603    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:16.913714 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.913032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:16.914542 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.914476    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 17:39:16.914630 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.914561    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 17:39:16.914630 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.914601    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4dl6t\""
Nov 02 17:39:16.915278 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.915258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:16.916526 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.916508    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zqcnj\""
Nov 02 17:39:16.916623 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.916535    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 17:39:16.916623 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.916581    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 17:39:16.917727 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.917463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:16.917727 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.917542    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:16.917934 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.917912    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 02 17:39:16.918583 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.918556    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 17:39:16.918889 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.918858    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 17:39:16.919770 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.919747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.920267 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.920248    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzjcr\""
Nov 02 17:39:16.920360 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.920294    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 17:39:16.922222 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.922205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:16.925111 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.925088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:16.927720 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.927416    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:16.927720 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:16.927480    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:16.928477 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5t9\" (UniqueName: \"kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:16.928550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljk8\" (UniqueName: \"kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.928683 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fg84\" (UniqueName: \"kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:16.928912 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.928993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929290 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26cd\" (UniqueName: \"kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.929748 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.929652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:16.930361 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.930176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:16.932357 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.932338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:16.957169 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.957142    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 17:39:16.957275 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.957214    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj65d"
Nov 02 17:39:16.969062 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.969030    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj65d"
Nov 02 17:39:16.994366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.994288    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"f23d73ef12b6a83fae531e9ed10d8052","Type":"ContainerStarted","Data":"34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7"}
Nov 02 17:39:16.995743 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:16.995715    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerStarted","Data":"a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c"}
Nov 02 17:39:17.013666 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.013644    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 17:39:17.013774 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.013692    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 17:39:17.014236 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.014218    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-kkqh6\""
Nov 02 17:39:17.014327 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.014292    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zvsl\""
Nov 02 17:39:17.014395 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.014382    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b2827\""
Nov 02 17:39:17.015086 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.015066    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jk79z\""
Nov 02 17:39:17.015242 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.015228    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rjwn5\""
Nov 02 17:39:17.015970 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.015948    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 17:39:17.016326 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016310    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 17:39:17.016407 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016394    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 17:39:17.016488 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016476    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 17:39:17.016541 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016530    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 17:39:17.016717 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016703    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 17:39:17.016786 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016775    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 17:39:17.016831 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016821    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:17.016992 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016969    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 17:39:17.017067 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.016996    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 17:39:17.017067 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017016    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 17:39:17.017163 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017077    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 17:39:17.017366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017351    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 17:39:17.017441 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017370    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:17.017523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017501    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 17:39:17.017850 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.017818    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 17:39:17.018693 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.018678    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 17:39:17.030206 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.030304 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxm5d\" (UniqueName: \"kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.030304 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.030411 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.030367    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:17.030411 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.030496 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.030496 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.030456    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:17.530417491 +0000 UTC m=+2.996688164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:17.030496 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030486    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030576    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030631    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.030660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030743    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030767    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030902    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.030958    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031047    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031061    2583 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031166    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031369    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031394 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031382    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031510    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031521    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fg84\" (UniqueName: \"kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.031787 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7hv\" (UniqueName: \"kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2f8f\" (UniqueName: \"kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.031970    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032034    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032262    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.032550 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032494    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5t9\" (UniqueName: \"kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032696    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032775    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.032857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033317    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:17.033414 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26cd\" (UniqueName: \"kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033512    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt4fn\" (UniqueName: \"kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljk8\" (UniqueName: \"kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033861    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033877    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.033963    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034005    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034123    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8vt\" (UniqueName: \"kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034601    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.034950 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.035572 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.035093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.035572 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.034717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.035572 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.035217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.035572 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.035235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:17.035572 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.035505    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.036803 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.036718    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.037828 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.037807    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:17.049943 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.049916    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:17.049943 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.049940    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:17.050094 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.049955    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:17.050094 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.050016    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:17.549999345 +0000 UTC m=+3.016270014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:17.052627 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.052580    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5t9\" (UniqueName: \"kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.053209 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.053170    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26cd\" (UniqueName: \"kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.055164 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.055134    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljk8\" (UniqueName: \"kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.057604 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.057577    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fg84\" (UniqueName: \"kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.135932 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.135893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.135937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.135966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.135987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136042    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4fn\" (UniqueName: \"kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136039    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136112 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136179    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136228    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8vt\" (UniqueName: \"kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.136523 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxm5d\" (UniqueName: \"kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7hv\" (UniqueName: \"kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2f8f\" (UniqueName: \"kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.137366 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.136784    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137561    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137781    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137810    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137833    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137881    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137903    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137928    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.137963    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138064    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.138119 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138098    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.138461 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138177    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.138461 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.138461 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.138267    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:17.138461 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.138305    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:17.63829334 +0000 UTC m=+3.104564005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:17.138461 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138442    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138625 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138531    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138625 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138595    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.138701 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138640    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.138796 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138781    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.138868 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138832    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.139012 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138894    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.139012 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138936    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.139012 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.138988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.139178 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.139056    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.139178 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.139066    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.139178 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.139106    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.139178 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.139151    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.140021 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.139994    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.140123 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.140033    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.142121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.142096    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.149449 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.149392    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxm5d\" (UniqueName: \"kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.150586 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.150563    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8vt\" (UniqueName: \"kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.150673 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.150570    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4fn\" (UniqueName: \"kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.151002 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.150975    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7hv\" (UniqueName: \"kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.152153 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.152135    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2f8f\" (UniqueName: \"kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.180627 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.180604    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:17.225039 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.224977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:17.233694 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.233668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:17.236306 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.236270    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14a0a20_b96d_426d_821a_4b5befbaa1d5.slice/crio-e814c567971d0d96b731707ca351ccef190331e76461757e123ef692dfc65363 WatchSource:0}: Error finding container e814c567971d0d96b731707ca351ccef190331e76461757e123ef692dfc65363: Status 404 returned error can't find the container with id e814c567971d0d96b731707ca351ccef190331e76461757e123ef692dfc65363
Nov 02 17:39:17.243350 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.243327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:17.243712 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.243677    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e9f10a_d472_47de_bb6d_fe29d2285945.slice/crio-38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382 WatchSource:0}: Error finding container 38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382: Status 404 returned error can't find the container with id 38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382
Nov 02 17:39:17.250623 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.250601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:17.254976 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.254741    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf1ac4f_ed4e_4fd8_ae47_5564e36c0229.slice/crio-9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6 WatchSource:0}: Error finding container 9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6: Status 404 returned error can't find the container with id 9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6
Nov 02 17:39:17.257059 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.257030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:17.264009 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.263982    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4b7b16_845b_45bd_b139_62a876719b5c.slice/crio-e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f WatchSource:0}: Error finding container e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f: Status 404 returned error can't find the container with id e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f
Nov 02 17:39:17.267857 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.267563    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc3e86b_8f7d_44da_8227_1240cf3b4167.slice/crio-193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce WatchSource:0}: Error finding container 193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce: Status 404 returned error can't find the container with id 193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce
Nov 02 17:39:17.280374 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.280345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:17.282515 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.282490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:17.292352 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.292318    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9cc0e7_d2b8_4c04_804d_bf25eb004bc4.slice/crio-60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62 WatchSource:0}: Error finding container 60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62: Status 404 returned error can't find the container with id 60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62
Nov 02 17:39:17.297631 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.297605    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2149ddc6_1523_41b7_8f17_2dd5f85a7825.slice/crio-fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496 WatchSource:0}: Error finding container fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496: Status 404 returned error can't find the container with id fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496
Nov 02 17:39:17.306193 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.306164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:17.308291 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.308267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:17.319379 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.319340    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf88b340_3cce_4031_8251_e39cedaf0916.slice/crio-6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a WatchSource:0}: Error finding container 6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a: Status 404 returned error can't find the container with id 6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a
Nov 02 17:39:17.320109 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:17.320085    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17ad10e_ee15_4ce8_861e_4e9ab8f8f02d.slice/crio-92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e WatchSource:0}: Error finding container 92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e: Status 404 returned error can't find the container with id 92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e
Nov 02 17:39:17.539607 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.539584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:17.539756 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.539737    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:17.539813 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.539802    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:18.53978656 +0000 UTC m=+4.006057235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:17.640955 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.640918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:17.641118 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.641004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:17.641118 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641103    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:17.641118 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641103    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:17.641257 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641133    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:17.641257 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641147    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:17.641257 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641151    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:18.64113823 +0000 UTC m=+4.107408895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:17.641257 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:17.641199    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:18.641183089 +0000 UTC m=+4.107453764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:17.972458 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.972408    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 17:34:16 +0000 UTC" deadline="2028-04-19 20:14:54.460108783 +0000 UTC"
Nov 02 17:39:17.972458 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:17.972457    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12818h35m36.487657228s"
Nov 02 17:39:18.005962 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.005924    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhdv5" event={"ID":"9cc3e86b-8f7d-44da-8227-1240cf3b4167","Type":"ContainerStarted","Data":"193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce"}
Nov 02 17:39:18.008588 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.008099    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9h65q" event={"ID":"e2e9f10a-d472-47de-bb6d-fe29d2285945","Type":"ContainerStarted","Data":"38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382"}
Nov 02 17:39:18.016210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.015472    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d3c8112ada91bb137b5c031fc287485" containerID="4731e519a5ab3b5d84c5bc237d3a35664b2b26235ab840e5935e3bcefb6e1bea" exitCode=0
Nov 02 17:39:18.016210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.015545    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerDied","Data":"4731e519a5ab3b5d84c5bc237d3a35664b2b26235ab840e5935e3bcefb6e1bea"}
Nov 02 17:39:18.026181 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.026148    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e"}
Nov 02 17:39:18.046487 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.046447    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt" event={"ID":"af88b340-3cce-4031-8251-e39cedaf0916","Type":"ContainerStarted","Data":"6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a"}
Nov 02 17:39:18.062512 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.062483    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cp4n" event={"ID":"2149ddc6-1523-41b7-8f17-2dd5f85a7825","Type":"ContainerStarted","Data":"fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496"}
Nov 02 17:39:18.079946 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.079911    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerStarted","Data":"60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62"}
Nov 02 17:39:18.082197 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.082146    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqvxr" event={"ID":"cf4b7b16-845b-45bd-b139-62a876719b5c","Type":"ContainerStarted","Data":"e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f"}
Nov 02 17:39:18.086091 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.086065    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5tc5" event={"ID":"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229","Type":"ContainerStarted","Data":"9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6"}
Nov 02 17:39:18.088782 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.088757    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vkzt5" event={"ID":"b14a0a20-b96d-426d-821a-4b5befbaa1d5","Type":"ContainerStarted","Data":"e814c567971d0d96b731707ca351ccef190331e76461757e123ef692dfc65363"}
Nov 02 17:39:18.547607 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.547558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:18.547800 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.547780    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:18.547892 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.547877    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:20.547834313 +0000 UTC m=+6.014104979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:18.647979 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.647946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:18.648129 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.648029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:18.648198 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648145    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:18.648253 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648201    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:20.648184673 +0000 UTC m=+6.114455340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:18.648588 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648566    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:18.648588 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648585    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:18.648714 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648598    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:18.648714 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.648642    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:20.648628489 +0000 UTC m=+6.114899158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:18.973458 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.973383    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 17:34:16 +0000 UTC" deadline="2028-05-20 17:44:50.317044612 +0000 UTC"
Nov 02 17:39:18.973458 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.973442    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13560h5m31.343607092s"
Nov 02 17:39:18.991635 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.990965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:18.991635 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.991104    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:18.991635 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.991495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:18.991635 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.991587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:18.992173 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:18.992143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:18.992284 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:18.992244    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:19.094972 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:19.094385    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerStarted","Data":"9daf5c9c9305d2e11434ee37e4a78a4b32ce7607c2da8745563a3be4f074c7e4"}
Nov 02 17:39:19.097468 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:19.097441    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"f23d73ef12b6a83fae531e9ed10d8052","Type":"ContainerStarted","Data":"0edfe25ae9d3beea2ecbd260c40bc8784aebe35b6da42a2a0a0ca5b2effe9599"}
Nov 02 17:39:19.137982 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:19.137920    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" podStartSLOduration=3.137898259 podStartE2EDuration="3.137898259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:19.119965885 +0000 UTC m=+4.586236559" watchObservedRunningTime="2026-11-02 17:39:19.137898259 +0000 UTC m=+4.604168935"
Nov 02 17:39:20.122632 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.122177    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerStarted","Data":"56438841a1d7bf95954ac8daafd5133933ff0c7a505a239a0d8151e5e6a09fa6"}
Nov 02 17:39:20.164015 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.163960    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal" podStartSLOduration=4.163931618 podStartE2EDuration="4.163931618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:19.138223197 +0000 UTC m=+4.604493871" watchObservedRunningTime="2026-11-02 17:39:20.163931618 +0000 UTC m=+5.630202294"
Nov 02 17:39:20.569782 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.569727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:20.569972 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.569914    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:20.570036 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.569980    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:24.569960119 +0000 UTC m=+10.036230784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:20.671017 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.670974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:20.671130 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.671044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:20.671186 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671171    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:20.671233 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671192    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:20.671233 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671202    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:20.671345 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671265    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:24.671249568 +0000 UTC m=+10.137520220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:20.671624 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671604    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:20.671708 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.671663    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:24.67164785 +0000 UTC m=+10.137918505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:20.991678 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.991645    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:20.991870 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.991777    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:20.992265 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.992245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:20.992358 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.992339    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:20.992408 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:20.992401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:20.992670 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:20.992483    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:21.127656 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:21.127461    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="56438841a1d7bf95954ac8daafd5133933ff0c7a505a239a0d8151e5e6a09fa6" exitCode=0
Nov 02 17:39:21.127656 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:21.127562    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"56438841a1d7bf95954ac8daafd5133933ff0c7a505a239a0d8151e5e6a09fa6"}
Nov 02 17:39:21.135885 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:21.135699    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9h65q" event={"ID":"e2e9f10a-d472-47de-bb6d-fe29d2285945","Type":"ContainerStarted","Data":"a7cbcf78a8870f1f6fa25af19e3927ab0b947ecb85cad7e22c84c05f2d04c106"}
Nov 02 17:39:21.191036 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:21.190979    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9h65q" podStartSLOduration=2.792989534 podStartE2EDuration="6.190958324s" totalImagesPullingTime="3.39796879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:21.190717784 +0000 UTC m=+6.656988450" watchObservedRunningTime="2026-11-02 17:39:21.190958324 +0000 UTC m=+6.657229018"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:22.995262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:22.995409    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:22.995795    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:22.995911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:22.995966    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:22.996090 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:22.996044    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:23.149709 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:23.149654    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqvxr" event={"ID":"cf4b7b16-845b-45bd-b139-62a876719b5c","Type":"ContainerStarted","Data":"9198ed414ff9b945d3b7b6ad4b97183284806dbcd8db09995642d959a756c1dd"}
Nov 02 17:39:23.688190 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:23.688158    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:23.689416 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:23.689392    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:23.750797 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:23.750736    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fqvxr" podStartSLOduration=3.675855812 podStartE2EDuration="8.750715441s" totalImagesPullingTime="5.074859629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:23.170423762 +0000 UTC m=+8.636694438" watchObservedRunningTime="2026-11-02 17:39:23.750715441 +0000 UTC m=+9.216986114"
Nov 02 17:39:24.154757 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.154717    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt" event={"ID":"af88b340-3cce-4031-8251-e39cedaf0916","Type":"ContainerStarted","Data":"d9a00d80250f90d8e317bbf2dba405745c5b424e3327aafcb6d39b2f6a7933ed"}
Nov 02 17:39:24.606406 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.606368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:24.606573 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.606511    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:24.606573 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.606570    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:32.606552825 +0000 UTC m=+18.072823480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:24.706783 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.706744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:24.706976 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.706817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:24.707049 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.706981    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:24.707049 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.707000    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:24.707049 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.707013    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:24.707197 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.707069    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:32.707050188 +0000 UTC m=+18.173320855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:24.707576 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.707558    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:24.707656 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.707600    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:32.7075887 +0000 UTC m=+18.173859366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:24.987272 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.987226    2583 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 17:39:24.992231 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.992209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:24.992353 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.992301    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:24.992582 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.992567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:24.992651 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.992630    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:24.992702 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:24.992690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:24.992751 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:24.992740    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:25.039102 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.039065    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:25.039863 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.039693    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:25.158320 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.158227    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt" event={"ID":"af88b340-3cce-4031-8251-e39cedaf0916","Type":"ContainerStarted","Data":"76717e79a7575ce37ef132fd394b3abe439338874a35fb9fb6b0ebe9f21d5ddd"}
Nov 02 17:39:25.161424 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.161351    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhdv5" event={"ID":"9cc3e86b-8f7d-44da-8227-1240cf3b4167","Type":"ContainerStarted","Data":"46a6f2d7fedcf0a97f94bb96c41103bbe55070ddb516f1d8be8b7cdabc921782"}
Nov 02 17:39:25.984888 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.984541    2583 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T17:39:24.987251654Z","UUID":"39b505a4-5bfe-4f51-8d99-80be6923ae0c","Handler":null,"Name":"","Endpoint":""}
Nov 02 17:39:25.986541 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.986519    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 17:39:25.986541 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:25.986546    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 17:39:26.165887 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.165833    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt" event={"ID":"af88b340-3cce-4031-8251-e39cedaf0916","Type":"ContainerStarted","Data":"3a292f1c1fca2e44dd2e27aeb485af13e9b94a9620bc812c5fe78005d72b1888"}
Nov 02 17:39:26.168358 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.168319    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="722cc1a2007b95e851bae0998013c7b0fcd419061720b5b320330ec545aa78a5" exitCode=0
Nov 02 17:39:26.168494 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.168403    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"722cc1a2007b95e851bae0998013c7b0fcd419061720b5b320330ec545aa78a5"}
Nov 02 17:39:26.171035 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.171012    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5tc5" event={"ID":"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229","Type":"ContainerStarted","Data":"33b8b83536a034f78ae68fc2bfd491485e70dfe514a8bb8e4063c300c5749f87"}
Nov 02 17:39:26.189742 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.189675    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt" podStartSLOduration=2.930952807 podStartE2EDuration="11.189660725s" totalImagesPullingTime="8.258707918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:26.189543358 +0000 UTC m=+11.655814035" watchObservedRunningTime="2026-11-02 17:39:26.189660725 +0000 UTC m=+11.655931410"
Nov 02 17:39:26.190343 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.190304    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-fhdv5" podStartSLOduration=3.628941024 podStartE2EDuration="11.19029522s" totalImagesPullingTime="7.561354196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:25.189253587 +0000 UTC m=+10.655524262" watchObservedRunningTime="2026-11-02 17:39:26.19029522 +0000 UTC m=+11.656565896"
Nov 02 17:39:26.208588 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.208536    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-b5tc5" podStartSLOduration=3.455844631 podStartE2EDuration="11.208518375s" totalImagesPullingTime="7.752673744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:26.20732872 +0000 UTC m=+11.673599395" watchObservedRunningTime="2026-11-02 17:39:26.208518375 +0000 UTC m=+11.674789051"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.989423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.989438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:26.989599    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:26.989650    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:26.989690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:26.991210 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:26.989813    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:27.174341 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:27.174302    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cp4n" event={"ID":"2149ddc6-1523-41b7-8f17-2dd5f85a7825","Type":"ContainerStarted","Data":"0a5088916216f1040dd30f594d5d0963053b58387f3f97d62b6d813bc571a527"}
Nov 02 17:39:27.177350 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:27.177324    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="ec6e2211b6b5762604e04b83641cc54106286f276e09fc4870d876675b5962fc" exitCode=0
Nov 02 17:39:27.178378 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:27.178354    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"ec6e2211b6b5762604e04b83641cc54106286f276e09fc4870d876675b5962fc"}
Nov 02 17:39:27.198135 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:27.198095    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8cp4n" podStartSLOduration=4.180813244 podStartE2EDuration="12.198080167s" totalImagesPullingTime="8.017266923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:27.197476273 +0000 UTC m=+12.663746947" watchObservedRunningTime="2026-11-02 17:39:27.198080167 +0000 UTC m=+12.664350841"
Nov 02 17:39:28.181976 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.181941    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="61b1cb38957cf7c73ebe50bd6f72283720249f0f8662fb9fef2d5b3f3214f1a7" exitCode=0
Nov 02 17:39:28.182439 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.182032    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"61b1cb38957cf7c73ebe50bd6f72283720249f0f8662fb9fef2d5b3f3214f1a7"}
Nov 02 17:39:28.184478 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.184455    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vkzt5" event={"ID":"b14a0a20-b96d-426d-821a-4b5befbaa1d5","Type":"ContainerStarted","Data":"3fdcd62cb0d767a3b7491e682f537745246ea312754c6e81fa6c254e9f747bde"}
Nov 02 17:39:28.237178 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.237074    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vkzt5" podStartSLOduration=3.329291467 podStartE2EDuration="13.237060051s" totalImagesPullingTime="9.907768584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:28.236827425 +0000 UTC m=+13.703098101" watchObservedRunningTime="2026-11-02 17:39:28.237060051 +0000 UTC m=+13.703330725"
Nov 02 17:39:28.989809 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.989760    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:28.989991 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:28.989888    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:28.989991 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.989925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:28.990077 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:28.990004    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:28.990077 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:28.990060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:28.990138 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:28.990117    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:30.192607 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:30.192571    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerStarted","Data":"8eea01770c9b6f27f3739e8ad9b2caae445908d945733fd2353852cb9f14b1c5"}
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:30.989872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:30.989988    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:30.989872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:30.990054    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:30.989872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:30.990377 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:30.990108    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:31.196909 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:31.196861    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="8eea01770c9b6f27f3739e8ad9b2caae445908d945733fd2353852cb9f14b1c5" exitCode=0
Nov 02 17:39:31.196909 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:31.196905    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"8eea01770c9b6f27f3739e8ad9b2caae445908d945733fd2353852cb9f14b1c5"}
Nov 02 17:39:32.202062 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.201885    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="0546a0d447983099145f61eaeda0635280195fe7433b5a08efb2ecfd14750ea5" exitCode=0
Nov 02 17:39:32.202560 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.201970    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerDied","Data":"0546a0d447983099145f61eaeda0635280195fe7433b5a08efb2ecfd14750ea5"}
Nov 02 17:39:32.204900 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.204804    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:32.205184 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205165    2583 generic.go:356] "Generic (PLEG): container finished" podID="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" containerID="33829db443abad3cf8702f9ae4566bf3fee59e5c127e6575f6f75a7465dee4db" exitCode=1
Nov 02 17:39:32.205250 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205198    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"1a73f4e5e0761659c870105374f086b8415592176fa10196410fa62989053c66"}
Nov 02 17:39:32.205282 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205251    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"3a012a8ecca13294173b00783b317bc79614dcda8989436472ef954dcfee78fe"}
Nov 02 17:39:32.205310 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205286    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"0db691722a9fddde3ea399cdd55e39853f2db15038da42d449d5dd7b3994415f"}
Nov 02 17:39:32.205340 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205324    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"f7602c8a019a10d342d379f0af872a4f3de5da827610c13bac782b6514698674"}
Nov 02 17:39:32.205374 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205353    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerDied","Data":"33829db443abad3cf8702f9ae4566bf3fee59e5c127e6575f6f75a7465dee4db"}
Nov 02 17:39:32.205405 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.205386    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"cd39a6fe082f61df2383ef321455b97d819ec3c7847f4c4b2079afe8bc2df0e4"}
Nov 02 17:39:32.662922 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.662901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:32.663067 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.663014    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:32.663104 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.663067    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret podName:d62c4231-ec62-436e-8eef-96bda48364c7 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.66305216 +0000 UTC m=+34.129322825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret") pod "global-pull-secret-syncer-fmrts" (UID: "d62c4231-ec62-436e-8eef-96bda48364c7") : object "kube-system"/"original-pull-secret" not registered
Nov 02 17:39:32.763346 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.763316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.763367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763445    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763466    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763483    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763492    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.763479898 +0000 UTC m=+34.229750563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 17:39:32.763497 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763494    2583 projected.go:196] Error preparing data for projected volume kube-api-access-26cq6 for pod openshift-network-diagnostics/network-check-target-9b9vg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:32.763681 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.763530    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6 podName:eacac3ba-6173-429b-a590-8e6393a738da nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.763519647 +0000 UTC m=+34.229790320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-26cq6" (UniqueName: "kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6") pod "network-check-target-9b9vg" (UID: "eacac3ba-6173-429b-a590-8e6393a738da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 17:39:32.989928 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.989853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:32.989928 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.989865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:32.989928 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:32.989872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:32.992970 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.990293    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:32.992970 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.990383    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:32.992970 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:32.990506    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:33.210089 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:33.210051    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" event={"ID":"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4","Type":"ContainerStarted","Data":"5a38f678fa418246f075ca59b92fff2cc5ce3d532391dd15d52e1989f5e943f1"}
Nov 02 17:39:33.238010 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:33.237965    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dk9mr" podStartSLOduration=8.167434721 podStartE2EDuration="18.237950954s" totalImagesPullingTime="10.070516233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:33.237877514 +0000 UTC m=+18.704148188" watchObservedRunningTime="2026-11-02 17:39:33.237950954 +0000 UTC m=+18.704221625"
Nov 02 17:39:34.215660 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:34.215633    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:34.216206 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:34.216069    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"9938d11c792ac6e2742060ddadde1d57e008ddeaddaea2baf81bfaf484ab4b43"}
Nov 02 17:39:34.989899 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:34.989870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:34.990107 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:34.989958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:34.990107 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:34.989960    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:34.990107 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:34.990053    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:34.990107 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:34.990075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:34.990333 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:34.990142    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:36.224049 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.223947    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:36.224563 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.224308    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"06be60d326ba3490ef151ee3bdca64fa98aa556d3ffe9884922c95a976bffb5e"}
Nov 02 17:39:36.224619 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.224603    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:36.224720 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.224694    2583 scope.go:122] "RemoveContainer" containerID="33829db443abad3cf8702f9ae4566bf3fee59e5c127e6575f6f75a7465dee4db"
Nov 02 17:39:36.241061 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.241040    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:36.989196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.989159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:36.989196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.989181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:36.989451 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:36.989269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:36.989451 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:36.989322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:36.989451 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:36.989417    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:36.989618 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:36.989490    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:37.231726 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.231698    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:37.232199 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.232115    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" event={"ID":"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d","Type":"ContainerStarted","Data":"2a6ab58001c871ef3cd8764771952cca2f0d65236821cca43378b2e52493c3bc"}
Nov 02 17:39:37.232352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.232331    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:37.232437 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.232421    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:37.249502 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.249435    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:37.274553 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.273799    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj" podStartSLOduration=8.206523761 podStartE2EDuration="22.273779159s" totalImagesPullingTime="14.067255398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:37.272964704 +0000 UTC m=+22.739235405" watchObservedRunningTime="2026-11-02 17:39:37.273779159 +0000 UTC m=+22.740049843"
Nov 02 17:39:37.782429 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.782396    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9b9vg"]
Nov 02 17:39:37.782589 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.782556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:37.782666 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:37.782648    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:37.786446 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.786416    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmrts"]
Nov 02 17:39:37.786561 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.786514    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:37.786612 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:37.786583    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:37.795577 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.795554    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rn4m9"]
Nov 02 17:39:37.795690 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:37.795661    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:37.795780 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:37.795759    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:38.989926 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:38.989893    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:38.989926 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:38.989926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:38.990435 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:38.990006    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:38.990435 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:38.990107    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:39.989212 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:39.989169    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:39.989428 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:39.989288    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:40.990019 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:40.989938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:40.990417 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:40.990081    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:40.990417 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:40.990125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:40.990417 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:40.990221    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:41.989131 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:41.989098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:41.989272 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:41.989193    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:42.989173 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:42.989140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:42.989535 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:42.989273    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmrts" podUID="d62c4231-ec62-436e-8eef-96bda48364c7"
Nov 02 17:39:42.989535 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:42.989316    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:42.989535 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:42.989410    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rn4m9" podUID="ff0f3fcf-4203-4f41-b835-07eb54829bc3"
Nov 02 17:39:43.989559 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:43.989527    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:43.989953 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:43.989629    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b9vg" podUID="eacac3ba-6173-429b-a590-8e6393a738da"
Nov 02 17:39:44.303490 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.303458    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeReady"
Nov 02 17:39:44.303622 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.303601    2583 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 02 17:39:44.344742 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.344712    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t5xrk"]
Nov 02 17:39:44.347712 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.347679    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:44.349317 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.349291    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d8jlp"]
Nov 02 17:39:44.352070 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.352054    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v9dk7"]
Nov 02 17:39:44.352181 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.352162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:44.354599 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.354581    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"]
Nov 02 17:39:44.354715 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.354694    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:44.356294 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.356279    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.356294 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.356292    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.357262 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.357246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.359967 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.359900    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"]
Nov 02 17:39:44.363265 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.363235    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 02 17:39:44.363361 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.363346    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"]
Nov 02 17:39:44.363591 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.363568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.366238 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.366215    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86cdd8bc45-6t746"]
Nov 02 17:39:44.366775 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.366749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.369279 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.369260    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"]
Nov 02 17:39:44.369399 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.369382    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.372195 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.372179    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"]
Nov 02 17:39:44.372405 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.372290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:44.375273 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.375256    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"]
Nov 02 17:39:44.375390 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.375375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.378060 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.378037    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"]
Nov 02 17:39:44.378207 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.378185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.381095 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.381076    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:39:44.382924 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.382644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.389171 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.389146    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:39:44.389541 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.389301    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.397370 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.395949    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"]
Nov 02 17:39:44.397370 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.396822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.400246 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.400229    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-j6zs5"]
Nov 02 17:39:44.400438 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.400418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:44.403209 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.403189    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t5xrk"]
Nov 02 17:39:44.403376 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.403227    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d8jlp"]
Nov 02 17:39:44.403376 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.403248    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"]
Nov 02 17:39:44.403376 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.403268    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"]
Nov 02 17:39:44.403376 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.403293    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xlnh4"]
Nov 02 17:39:44.404052 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.404035    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.408390 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.408370    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"]
Nov 02 17:39:44.408472 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.408409    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"]
Nov 02 17:39:44.408472 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.408432    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t682l"]
Nov 02 17:39:44.408590 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.408489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411556    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86cdd8bc45-6t746"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411588    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-j6zs5"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411607    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411628    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411647    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v9dk7"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411672    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411692    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlnh4"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411718    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411738    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411757    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"]
Nov 02 17:39:44.412121 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.411860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.419885 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.418411    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t682l"]
Nov 02 17:39:44.450042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.450132 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8nd\" (UniqueName: \"kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.450132 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgzf\" (UniqueName: \"kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf\") pod \"volume-data-source-validator-58c9f5f46d-hlgbg\" (UID: \"c660205d-a64f-4693-9175-dc3d82e75ecc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:44.450198 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldb6\" (UniqueName: \"kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.450230 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.450230 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.450289 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kclwt\" (UniqueName: \"kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt\") pod \"kas-connection-checker-685895c7c9-t5xrk\" (UID: \"e2978e7a-385f-4edb-8bac-e691bb7e8c69\") " pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:44.450289 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2bzr\" (UniqueName: \"kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr\") pod \"kas-connection-checker-685895c7c9-d8jlp\" (UID: \"dc5bbef7-9279-44d0-b1fb-0dd242c10b88\") " pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:44.450344 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.450372 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.450405 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.450446 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.450478 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.450507 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450478    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpz78\" (UniqueName: \"kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.450507 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.450566 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.450566 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.450566 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pps24\" (UniqueName: \"kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.450643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.450643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.450643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpw8p\" (UniqueName: \"kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p\") pod \"kas-connection-checker-685895c7c9-v9dk7\" (UID: \"d125ccb7-dd74-43c4-8bdf-970121de6423\") " pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:44.450736 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.450656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwkt\" (UniqueName: \"kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.456779 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.456754    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.456941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.456926    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457301    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457343    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457379    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457385    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457418    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457426    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457439    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457465    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.457543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.457493    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 02 17:39:44.458139 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458125    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.458203 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458175    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 02 17:39:44.458272 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458258    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.458324 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458297    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.458324 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458259    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.458324 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458310    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 17:39:44.458679 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458659    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.458825 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.458812    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 02 17:39:44.459833 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.459815    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 02 17:39:44.459941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.459851    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 02 17:39:44.459941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.459878    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.459941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.459890    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.459941 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.459915    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 17:39:44.462237 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.462218    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.462316 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.462248    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 02 17:39:44.462316 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.462275    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.463918 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.463905    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:44.468017 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.467997    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 02 17:39:44.475925 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.475899    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 02 17:39:44.475925 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.475915    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 02 17:39:44.476062 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.475917    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 02 17:39:44.476062 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.475903    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 02 17:39:44.476062 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.475930    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 02 17:39:44.476258 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.476244    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 02 17:39:44.477926 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477906    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4rgm\""
Nov 02 17:39:44.477926 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477916    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 02 17:39:44.478055 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477927    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 02 17:39:44.478055 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477946    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 02 17:39:44.478055 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477960    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 17:39:44.478055 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.477974    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 02 17:39:44.478188 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.478087    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 02 17:39:44.478188 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.478150    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 17:39:44.479745 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.479729    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 02 17:39:44.479823 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.479753    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-scp8s\""
Nov 02 17:39:44.480996 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.480982    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 02 17:39:44.481072 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.481054    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 02 17:39:44.481126 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.481057    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gjv4t\""
Nov 02 17:39:44.481126 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.481071    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs2ss\""
Nov 02 17:39:44.481345 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.481328    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-th4zf\""
Nov 02 17:39:44.483041 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.483022    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 02 17:39:44.551066 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.550989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.551066 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qml5k\" (UniqueName: \"kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.551066 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.551263 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.551263 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps24\" (UniqueName: \"kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.551263 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.551263 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhszd\" (UniqueName: \"kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd\") pod \"network-check-source-6f78d59f99-p7tvx\" (UID: \"5d2d7655-ead5-46f0-9837-9cb4a2671721\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:44.551379 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.551379 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.551475 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.551475 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.551567 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.551567 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.551640 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.551640 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.551640 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78sjv\" (UniqueName: \"kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.551774 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.551774 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.551774 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.551747    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.051724717 +0000 UTC m=+30.517995402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : configmap references non-existent config key: service-ca.crt
Nov 02 17:39:44.551933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8nd\" (UniqueName: \"kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.551933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bzr\" (UniqueName: \"kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr\") pod \"kas-connection-checker-685895c7c9-d8jlp\" (UID: \"dc5bbef7-9279-44d0-b1fb-0dd242c10b88\") " pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:44.551933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.551933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.551933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.552114 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.551956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgzf\" (UniqueName: \"kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf\") pod \"volume-data-source-validator-58c9f5f46d-hlgbg\" (UID: \"c660205d-a64f-4693-9175-dc3d82e75ecc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:44.552114 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.552114 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.552039    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:44.552114 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.552096    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls podName:3ba0d151-94e7-450f-8b5d-3873a538a8a9 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.052081792 +0000 UTC m=+30.518352445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-lckhg" (UID: "3ba0d151-94e7-450f-8b5d-3873a538a8a9") : secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:44.552312 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qm4\" (UniqueName: \"kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.552312 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.552312 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.552312 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.552312 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552282    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.552438    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552506    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.552543 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.552536    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls podName:1096cec7-3002-445f-aa4a-0fe1a6f1fab8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.052520718 +0000 UTC m=+30.518791384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-h27kn" (UID: "1096cec7-3002-445f-aa4a-0fe1a6f1fab8") : secret "samples-operator-tls" not found
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q452d\" (UniqueName: \"kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz78\" (UniqueName: \"kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552707    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.552805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552912    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.552921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpw8p\" (UniqueName: \"kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p\") pod \"kas-connection-checker-685895c7c9-v9dk7\" (UID: \"d125ccb7-dd74-43c4-8bdf-970121de6423\") " pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.552980    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.553030    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.053015434 +0000 UTC m=+30.519286109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwkt\" (UniqueName: \"kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.553093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldb6\" (UniqueName: \"kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.553470 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kclwt\" (UniqueName: \"kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt\") pod \"kas-connection-checker-685895c7c9-t5xrk\" (UID: \"e2978e7a-385f-4edb-8bac-e691bb7e8c69\") " pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:44.553919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.553919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.553919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.553919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553789    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.553919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.553813    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.556019 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.555998    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.556131 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.556036    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.556267 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.556248    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.556299 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.556248    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.564360 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.564341    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8nd\" (UniqueName: \"kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:44.565157 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.565126    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps24\" (UniqueName: \"kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.566988 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.566962    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpw8p\" (UniqueName: \"kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p\") pod \"kas-connection-checker-685895c7c9-v9dk7\" (UID: \"d125ccb7-dd74-43c4-8bdf-970121de6423\") " pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:44.567911 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.567857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgzf\" (UniqueName: \"kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf\") pod \"volume-data-source-validator-58c9f5f46d-hlgbg\" (UID: \"c660205d-a64f-4693-9175-dc3d82e75ecc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:44.569046 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.569005    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldb6\" (UniqueName: \"kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:44.569046 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.569015    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bzr\" (UniqueName: \"kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr\") pod \"kas-connection-checker-685895c7c9-d8jlp\" (UID: \"dc5bbef7-9279-44d0-b1fb-0dd242c10b88\") " pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:44.569046 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.569029    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz78\" (UniqueName: \"kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:44.569239 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.569149    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kclwt\" (UniqueName: \"kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt\") pod \"kas-connection-checker-685895c7c9-t5xrk\" (UID: \"e2978e7a-385f-4edb-8bac-e691bb7e8c69\") " pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:44.570187 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.570169    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwkt\" (UniqueName: \"kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.653989 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.653956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.653989 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.653989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q452d\" (UniqueName: \"kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.654118    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.654174    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls podName:60a4d219-d7c3-4dce-b7fd-fa05c2fb7943 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.154156179 +0000 UTC m=+30.620426847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls") pod "dns-default-xlnh4" (UID: "60a4d219-d7c3-4dce-b7fd-fa05c2fb7943") : secret "dns-default-metrics-tls" not found
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.654219 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.654214    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.654290    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.154270923 +0000 UTC m=+30.620541589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654453    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.654643 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654748    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.654958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654757    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654990    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.654767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qml5k\" (UniqueName: \"kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhszd\" (UniqueName: \"kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd\") pod \"network-check-source-6f78d59f99-p7tvx\" (UID: \"5d2d7655-ead5-46f0-9837-9cb4a2671721\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655175    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.655243 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sjv\" (UniqueName: \"kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qm4\" (UniqueName: \"kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655564    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.655647    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.655659    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6589b9bd-vlx6x: secret "image-registry-tls" not found
Nov 02 17:39:44.655830 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655691    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.655931    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.656301    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.656339    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.656383    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls podName:6c5488c4-85f7-46b9-923b-a2f29bf8d1d8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.156366993 +0000 UTC m=+30.622637658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls") pod "image-registry-f6589b9bd-vlx6x" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8") : secret "image-registry-tls" not found
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.656406    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.656418    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc: secret "image-registry-tls" not found
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:44.656468    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls podName:57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf nodeName:}" failed. No retries permitted until 2026-11-02 17:39:45.156454086 +0000 UTC m=+30.622724738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls") pod "image-registry-5fb5fdd4d9-nv2tc" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf") : secret "image-registry-tls" not found
Nov 02 17:39:44.656552 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.656516    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.657716 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.657432    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.657716 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.657452    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.657716 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.657665    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.658252 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.658225    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.658764 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.658744    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.658876 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.658854    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.658967 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.658952    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.660060 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.660042    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.662551 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.662534    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:44.666629 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.666611    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q452d\" (UniqueName: \"kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.670202 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.670166    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.671044 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.670430    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:44.671044 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.670584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sjv\" (UniqueName: \"kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.671044 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.671001    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhszd\" (UniqueName: \"kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd\") pod \"network-check-source-6f78d59f99-p7tvx\" (UID: \"5d2d7655-ead5-46f0-9837-9cb4a2671721\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:44.671229 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.671200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.672203 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.672185    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qml5k\" (UniqueName: \"kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.672280 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.672248    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qm4\" (UniqueName: \"kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:44.672430 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.672414    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:44.672849 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.672817    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:44.679468 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.679449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:44.716540 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.714880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:44.729636 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.729560    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:44.739348 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.735822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:44.744428 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.744399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:44.768512 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.768485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:44.777679 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.777628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:44.790199 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.789809    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:44.971713 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.971582    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t5xrk"]
Nov 02 17:39:44.975121 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:44.975093    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2978e7a_385f_4edb_8bac_e691bb7e8c69.slice/crio-3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c WatchSource:0}: Error finding container 3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c: Status 404 returned error can't find the container with id 3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c
Nov 02 17:39:44.976026 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.975853    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d8jlp"]
Nov 02 17:39:44.977335 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.977240    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v9dk7"]
Nov 02 17:39:44.977951 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:44.977926    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5bbef7_9279_44d0_b1fb_0dd242c10b88.slice/crio-accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729 WatchSource:0}: Error finding container accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729: Status 404 returned error can't find the container with id accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729
Nov 02 17:39:44.978637 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:44.978618    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd125ccb7_dd74_43c4_8bdf_970121de6423.slice/crio-a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f WatchSource:0}: Error finding container a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f: Status 404 returned error can't find the container with id a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f
Nov 02 17:39:44.999016 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.998989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:44.999981 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:44.999633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:45.005241 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.005222    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 17:39:45.005541 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.005515    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-mkftb\""
Nov 02 17:39:45.005629 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.005551    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 17:39:45.005685 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.005629    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7mg2x\""
Nov 02 17:39:45.051132 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.051095    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"]
Nov 02 17:39:45.060236 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.060207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:45.060345 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.060326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:45.060399 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.060376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:45.060462 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.060447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:45.060587 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060566    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.060542755 +0000 UTC m=+31.526813424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : configmap references non-existent config key: service-ca.crt
Nov 02 17:39:45.060659 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060579    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 02 17:39:45.060659 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060622    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls podName:1096cec7-3002-445f-aa4a-0fe1a6f1fab8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.060610494 +0000 UTC m=+31.526881165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-h27kn" (UID: "1096cec7-3002-445f-aa4a-0fe1a6f1fab8") : secret "samples-operator-tls" not found
Nov 02 17:39:45.060659 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060629    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:45.060659 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060652    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:45.060826 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060679    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls podName:3ba0d151-94e7-450f-8b5d-3873a538a8a9 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.060663778 +0000 UTC m=+31.526934433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-lckhg" (UID: "3ba0d151-94e7-450f-8b5d-3873a538a8a9") : secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:45.060826 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.060699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.060689222 +0000 UTC m=+31.526959888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:45.075358 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.075293    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"]
Nov 02 17:39:45.081231 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.081211    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"]
Nov 02 17:39:45.104819 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.104792    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-j6zs5"]
Nov 02 17:39:45.116800 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:45.116773    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442db46e_32cb_4277_a51c_fae4c064c817.slice/crio-1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3 WatchSource:0}: Error finding container 1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3: Status 404 returned error can't find the container with id 1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3
Nov 02 17:39:45.121877 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.119400    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"]
Nov 02 17:39:45.125573 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:45.125118    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ca2f8a_a233_42ed_87be_78984e39ee6f.slice/crio-02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda WatchSource:0}: Error finding container 02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda: Status 404 returned error can't find the container with id 02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda
Nov 02 17:39:45.134436 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.134412    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"]
Nov 02 17:39:45.135397 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.135375    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t682l"]
Nov 02 17:39:45.140877 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:45.140827    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2d7655_ead5_46f0_9837_9cb4a2671721.slice/crio-6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6 WatchSource:0}: Error finding container 6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6: Status 404 returned error can't find the container with id 6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6
Nov 02 17:39:45.142627 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:45.142605    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203127f1_2169_422e_a508_793327fd6553.slice/crio-0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e WatchSource:0}: Error finding container 0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e: Status 404 returned error can't find the container with id 0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e
Nov 02 17:39:45.161684 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.161653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:45.161808 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.161789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:45.161900 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.161804    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:45.161900 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.161895    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.161873257 +0000 UTC m=+31.628143926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:45.162021 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.162004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:45.162077 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162035    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:45.162077 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162050    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc: secret "image-registry-tls" not found
Nov 02 17:39:45.162077 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.162053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:45.162213 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162089    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls podName:57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.16207679 +0000 UTC m=+31.628347660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls") pod "image-registry-5fb5fdd4d9-nv2tc" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf") : secret "image-registry-tls" not found
Nov 02 17:39:45.162213 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162198    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:45.162213 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162208    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6589b9bd-vlx6x: secret "image-registry-tls" not found
Nov 02 17:39:45.162351 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162240    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls podName:6c5488c4-85f7-46b9-923b-a2f29bf8d1d8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.162229125 +0000 UTC m=+31.628499790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls") pod "image-registry-f6589b9bd-vlx6x" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8") : secret "image-registry-tls" not found
Nov 02 17:39:45.162351 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162301    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 17:39:45.162351 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:45.162333    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls podName:60a4d219-d7c3-4dce-b7fd-fa05c2fb7943 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:46.162323248 +0000 UTC m=+31.628593926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls") pod "dns-default-xlnh4" (UID: "60a4d219-d7c3-4dce-b7fd-fa05c2fb7943") : secret "dns-default-metrics-tls" not found
Nov 02 17:39:45.250997 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.250955    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8" event={"ID":"1520f556-1207-43c4-afad-fe19f9bbf7c0","Type":"ContainerStarted","Data":"c8d04333d1d35afc29f2663396074f5274e617bc8ae0887ca0a488f9c596c9b8"}
Nov 02 17:39:45.252114 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.252089    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs" event={"ID":"85ca2f8a-a233-42ed-87be-78984e39ee6f","Type":"ContainerStarted","Data":"02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda"}
Nov 02 17:39:45.253150 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.253123    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" event={"ID":"0d111045-5f11-4638-9002-179905dd2006","Type":"ContainerStarted","Data":"b8c296e1d0ee99a2348802922581094870cfe50d1b2d7f3b893e2598a1832c1f"}
Nov 02 17:39:45.254543 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.254519    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-v9dk7" event={"ID":"d125ccb7-dd74-43c4-8bdf-970121de6423","Type":"ContainerStarted","Data":"05b654c2739753b28cbf443d9e7afe2191e2d645ab3e28e7466601b49646d953"}
Nov 02 17:39:45.254615 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.254564    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-v9dk7" event={"ID":"d125ccb7-dd74-43c4-8bdf-970121de6423","Type":"ContainerStarted","Data":"a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f"}
Nov 02 17:39:45.255833 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.255813    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-d8jlp" event={"ID":"dc5bbef7-9279-44d0-b1fb-0dd242c10b88","Type":"ContainerStarted","Data":"07a4b973e760e5268c3ae4766a83defd03fe5c9b68ca96ce6431cdaece9d296f"}
Nov 02 17:39:45.255913 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.255873    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-d8jlp" event={"ID":"dc5bbef7-9279-44d0-b1fb-0dd242c10b88","Type":"ContainerStarted","Data":"accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729"}
Nov 02 17:39:45.257018 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.256996    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-j6zs5" event={"ID":"442db46e-32cb-4277-a51c-fae4c064c817","Type":"ContainerStarted","Data":"1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3"}
Nov 02 17:39:45.258099 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.258070    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg" event={"ID":"c660205d-a64f-4693-9175-dc3d82e75ecc","Type":"ContainerStarted","Data":"e5306838b0b34134bacf8ac9fa316b8bf2d1303ad42260edb4f0a082e571a96f"}
Nov 02 17:39:45.259504 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.259485    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t5xrk" event={"ID":"e2978e7a-385f-4edb-8bac-e691bb7e8c69","Type":"ContainerStarted","Data":"ed30932dfbb0f068fb50e694b33d8b8e6227e8c25c3431abaac2b65c93c53afb"}
Nov 02 17:39:45.259597 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.259521    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t5xrk" event={"ID":"e2978e7a-385f-4edb-8bac-e691bb7e8c69","Type":"ContainerStarted","Data":"3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c"}
Nov 02 17:39:45.260547 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.260529    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t682l" event={"ID":"203127f1-2169-422e-a508-793327fd6553","Type":"ContainerStarted","Data":"0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e"}
Nov 02 17:39:45.261512 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.261495    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx" event={"ID":"5d2d7655-ead5-46f0-9837-9cb4a2671721","Type":"ContainerStarted","Data":"6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6"}
Nov 02 17:39:45.274987 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.274948    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-v9dk7" podStartSLOduration=415.274933758 podStartE2EDuration="6m55.274933758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:45.274042495 +0000 UTC m=+30.740313170" watchObservedRunningTime="2026-11-02 17:39:45.274933758 +0000 UTC m=+30.741204433"
Nov 02 17:39:45.292348 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.292312    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-d8jlp" podStartSLOduration=415.292302314 podStartE2EDuration="6m55.292302314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:45.291647901 +0000 UTC m=+30.757918575" watchObservedRunningTime="2026-11-02 17:39:45.292302314 +0000 UTC m=+30.758572987"
Nov 02 17:39:45.310936 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.310857    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-t5xrk" podStartSLOduration=415.310829681 podStartE2EDuration="6m55.310829681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:45.310318213 +0000 UTC m=+30.776588887" watchObservedRunningTime="2026-11-02 17:39:45.310829681 +0000 UTC m=+30.777100355"
Nov 02 17:39:45.990113 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.990079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:45.995944 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:45.995919    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-6x7d8\""
Nov 02 17:39:46.069889 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.069853    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:46.070355 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.069958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:46.070355 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.070029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:46.070355 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.070139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:46.070355 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.070298    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.070276767 +0000 UTC m=+33.536547443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : configmap references non-existent config key: service-ca.crt
Nov 02 17:39:46.070765 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.070744    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:46.070830 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.070814    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls podName:3ba0d151-94e7-450f-8b5d-3873a538a8a9 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.070797175 +0000 UTC m=+33.537067846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-lckhg" (UID: "3ba0d151-94e7-450f-8b5d-3873a538a8a9") : secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:46.070966 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.070900    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 02 17:39:46.070966 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.070950    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls podName:1096cec7-3002-445f-aa4a-0fe1a6f1fab8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.070936784 +0000 UTC m=+33.537207452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-h27kn" (UID: "1096cec7-3002-445f-aa4a-0fe1a6f1fab8") : secret "samples-operator-tls" not found
Nov 02 17:39:46.071064 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.071005    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:46.071064 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.071038    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.071027901 +0000 UTC m=+33.537298568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:46.170754 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.170709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:46.170983 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.170775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:46.170983 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.170895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:46.171109 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:46.170989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:46.171164 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171137    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:46.171164 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171151    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6589b9bd-vlx6x: secret "image-registry-tls" not found
Nov 02 17:39:46.171248 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171206    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls podName:6c5488c4-85f7-46b9-923b-a2f29bf8d1d8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.17118866 +0000 UTC m=+33.637459316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls") pod "image-registry-f6589b9bd-vlx6x" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8") : secret "image-registry-tls" not found
Nov 02 17:39:46.171308 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171273    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 17:39:46.171363 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171310    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls podName:60a4d219-d7c3-4dce-b7fd-fa05c2fb7943 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.171296193 +0000 UTC m=+33.637566847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls") pod "dns-default-xlnh4" (UID: "60a4d219-d7c3-4dce-b7fd-fa05c2fb7943") : secret "dns-default-metrics-tls" not found
Nov 02 17:39:46.171730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171426    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:46.171730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171482    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.171470564 +0000 UTC m=+33.637741219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:46.171730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171550    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:46.171730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171560    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc: secret "image-registry-tls" not found
Nov 02 17:39:46.171730 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:46.171600    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls podName:57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf nodeName:}" failed. No retries permitted until 2026-11-02 17:39:48.171590241 +0000 UTC m=+33.637860897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls") pod "image-registry-5fb5fdd4d9-nv2tc" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf") : secret "image-registry-tls" not found
Nov 02 17:39:48.092817 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.092778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.092860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.092939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.092995    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.092970731 +0000 UTC m=+37.559241396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : configmap references non-existent config key: service-ca.crt
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093053    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.093059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093093    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls podName:1096cec7-3002-445f-aa4a-0fe1a6f1fab8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.093082812 +0000 UTC m=+37.559353464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-h27kn" (UID: "1096cec7-3002-445f-aa4a-0fe1a6f1fab8") : secret "samples-operator-tls" not found
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093147    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093185    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.093173803 +0000 UTC m=+37.559444468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093197    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:48.093375 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.093223    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls podName:3ba0d151-94e7-450f-8b5d-3873a538a8a9 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.093216731 +0000 UTC m=+37.559487383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-lckhg" (UID: "3ba0d151-94e7-450f-8b5d-3873a538a8a9") : secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.194622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.194748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.194800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194824    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194867    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc: secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194917    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194925    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194945    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6589b9bd-vlx6x: secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.194850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194923    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls podName:57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.194907181 +0000 UTC m=+37.661177856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls") pod "image-registry-5fb5fdd4d9-nv2tc" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf") : secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.194991    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.195008    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.194992208 +0000 UTC m=+37.661262865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.195025    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls podName:6c5488c4-85f7-46b9-923b-a2f29bf8d1d8 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.19501653 +0000 UTC m=+37.661287188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls") pod "image-registry-f6589b9bd-vlx6x" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8") : secret "image-registry-tls" not found
Nov 02 17:39:48.195030 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.195041    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls podName:60a4d219-d7c3-4dce-b7fd-fa05c2fb7943 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.195033202 +0000 UTC m=+37.661303877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls") pod "dns-default-xlnh4" (UID: "60a4d219-d7c3-4dce-b7fd-fa05c2fb7943") : secret "dns-default-metrics-tls" not found
Nov 02 17:39:48.284433 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.284364    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg" event={"ID":"c660205d-a64f-4693-9175-dc3d82e75ecc","Type":"ContainerStarted","Data":"a636d65e5bed996a6ceb83681c807652480984c759eb816df7191ce055fe77d8"}
Nov 02 17:39:48.702210 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.702172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:48.706215 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.706184    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:48.804931 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.803646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:48.804931 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.803762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:48.804931 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.804531    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 02 17:39:48.804931 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:48.804623    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs podName:ff0f3fcf-4203-4f41-b835-07eb54829bc3 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:20.804599922 +0000 UTC m=+66.270870599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs") pod "network-metrics-daemon-rn4m9" (UID: "ff0f3fcf-4203-4f41-b835-07eb54829bc3") : secret "metrics-daemon-secret" not found
Nov 02 17:39:48.807820 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.807781    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:48.925891 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:48.925855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:49.024176 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:49.023991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:49.240444 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:49.240377    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg" podStartSLOduration=388.833194199 podStartE2EDuration="6m31.240352343s" totalImagesPullingTime="2.407158144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:48.305963152 +0000 UTC m=+33.772233828" watchObservedRunningTime="2026-11-02 17:39:49.240352343 +0000 UTC m=+34.706623036"
Nov 02 17:39:49.241855 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:49.241810    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmrts"]
Nov 02 17:39:49.272590 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:49.272555    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62c4231_ec62_436e_8eef_96bda48364c7.slice/crio-d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d WatchSource:0}: Error finding container d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d: Status 404 returned error can't find the container with id d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d
Nov 02 17:39:49.288874 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:49.288787    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmrts" event={"ID":"d62c4231-ec62-436e-8eef-96bda48364c7","Type":"ContainerStarted","Data":"d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d"}
Nov 02 17:39:49.342209 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:49.342137    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9b9vg"]
Nov 02 17:39:49.346896 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:49.346863    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacac3ba_6173_429b_a590_8e6393a738da.slice/crio-e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1 WatchSource:0}: Error finding container e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1: Status 404 returned error can't find the container with id e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1
Nov 02 17:39:50.293135 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:50.293105    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9b9vg" event={"ID":"eacac3ba-6173-429b-a590-8e6393a738da","Type":"ContainerStarted","Data":"e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1"}
Nov 02 17:39:51.302964 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.302896    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t682l" event={"ID":"203127f1-2169-422e-a508-793327fd6553","Type":"ContainerStarted","Data":"5e63b73194bee27b9b8669a929679dc7983a903b8063746a3c96c3a339c496b3"}
Nov 02 17:39:51.305196 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.305127    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx" event={"ID":"5d2d7655-ead5-46f0-9837-9cb4a2671721","Type":"ContainerStarted","Data":"cd0b572a9a7c6de860bbaa5534e92ef2696024eaddeba543f7da4cd1aee761df"}
Nov 02 17:39:51.309527 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.309504    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8" event={"ID":"1520f556-1207-43c4-afad-fe19f9bbf7c0","Type":"ContainerStarted","Data":"fe4e979c0cf9db8d8c25be38f4a39a302fa04d306e7c7dbe0eb20799a52f1df7"}
Nov 02 17:39:51.314306 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.313232    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jb2qt"]
Nov 02 17:39:51.317546 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.317525    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/0.log"
Nov 02 17:39:51.317636 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.317579    2583 generic.go:356] "Generic (PLEG): container finished" podID="0d111045-5f11-4638-9002-179905dd2006" containerID="9d22013b49444a3d9f10ad66b9ced37d7ed3f4c70cf8825ef5e5e70f70659570" exitCode=255
Nov 02 17:39:51.317933 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.317917    2583 scope.go:122] "RemoveContainer" containerID="9d22013b49444a3d9f10ad66b9ced37d7ed3f4c70cf8825ef5e5e70f70659570"
Nov 02 17:39:51.334897 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.334099    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs" event={"ID":"85ca2f8a-a233-42ed-87be-78984e39ee6f","Type":"ContainerStarted","Data":"14b62a0e66672157811b50fcf2e8de324ec9c63b74b644fde468bfdf61b55961"}
Nov 02 17:39:51.334897 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.334137    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" event={"ID":"0d111045-5f11-4638-9002-179905dd2006","Type":"ContainerDied","Data":"9d22013b49444a3d9f10ad66b9ced37d7ed3f4c70cf8825ef5e5e70f70659570"}
Nov 02 17:39:51.334897 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.334163    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-j6zs5" event={"ID":"442db46e-32cb-4277-a51c-fae4c064c817","Type":"ContainerStarted","Data":"3337e15e68d9afb6e5025f5de1224870aee069b98e128b08af8159a8ea8d4201"}
Nov 02 17:39:51.334897 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.334264    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.336966 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.336921    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t682l" podStartSLOduration=1.6709002499999999 podStartE2EDuration="7.336902999s" totalImagesPullingTime="5.666002749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:51.330812608 +0000 UTC m=+36.797083281" watchObservedRunningTime="2026-11-02 17:39:51.336902999 +0000 UTC m=+36.803173675"
Nov 02 17:39:51.338175 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.338104    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jb2qt"]
Nov 02 17:39:51.342005 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.341981    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:39:51.351017 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.350994    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 17:39:51.351161 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.351145    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7flsb\""
Nov 02 17:39:51.351220 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.351182    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 17:39:51.370633 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.370593    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:39:51.379380 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.370729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.396866 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.390177    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4kkz9\""
Nov 02 17:39:51.412223 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.412161    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs" podStartSLOduration=390.301252289 podStartE2EDuration="6m35.412144573s" totalImagesPullingTime="5.110892284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:51.412029117 +0000 UTC m=+36.878299807" watchObservedRunningTime="2026-11-02 17:39:51.412144573 +0000 UTC m=+36.878415248"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjzj\" (UniqueName: \"kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.429824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.432631 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.431525    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"]
Nov 02 17:39:51.456964 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.453218    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"]
Nov 02 17:39:51.456964 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.453352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:51.460614 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.460556    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-j6zs5" podStartSLOduration=384.342363687 podStartE2EDuration="6m29.460537049s" totalImagesPullingTime="5.118173362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:51.455027464 +0000 UTC m=+36.921298141" watchObservedRunningTime="2026-11-02 17:39:51.460537049 +0000 UTC m=+36.926807725"
Nov 02 17:39:51.468747 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.468724    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v8fl6\""
Nov 02 17:39:51.474958 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.469089    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 02 17:39:51.475124 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.469146    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:51.485979 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.485954    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"]
Nov 02 17:39:51.486502 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.486228    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"]
Nov 02 17:39:51.486502 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.486173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:51.490372 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.488647    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx" podStartSLOduration=381.80642802 podStartE2EDuration="6m27.488631069s" totalImagesPullingTime="5.682203049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:51.487774052 +0000 UTC m=+36.954044726" watchObservedRunningTime="2026-11-02 17:39:51.488631069 +0000 UTC m=+36.954901744"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwssv\" (UniqueName: \"kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv\") pod \"migrator-66df5d496b-qpv2w\" (UID: \"e3da2857-f9bf-40a6-8b02-46423bcd5516\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjzj\" (UniqueName: \"kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.530994    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mln9g\" (UniqueName: \"kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g\") pod \"migrator-66df5d496b-csrzn\" (UID: \"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.531121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:51.531213    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:51.531275    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.031256317 +0000 UTC m=+37.497526973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : configmap "kube-rbac-proxy" not found
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.531497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:51.531581    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:51.531627    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:52.031612784 +0000 UTC m=+37.497883436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532163    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.533352 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.534274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.534274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.532897    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.534274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.533131    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.534274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.533177    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.548079 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.548027    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8" podStartSLOduration=384.390380843 podStartE2EDuration="6m29.548007897s" totalImagesPullingTime="5.157627054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:51.516660305 +0000 UTC m=+36.982930980" watchObservedRunningTime="2026-11-02 17:39:51.548007897 +0000 UTC m=+37.014278571"
Nov 02 17:39:51.553811 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.553749    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.558214 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.558186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjzj\" (UniqueName: \"kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:51.633182 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.633144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwssv\" (UniqueName: \"kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv\") pod \"migrator-66df5d496b-qpv2w\" (UID: \"e3da2857-f9bf-40a6-8b02-46423bcd5516\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:51.633378 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.633242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mln9g\" (UniqueName: \"kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g\") pod \"migrator-66df5d496b-csrzn\" (UID: \"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:51.639886 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.639853    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fx2ps"]
Nov 02 17:39:51.650548 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.650519    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mln9g\" (UniqueName: \"kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g\") pod \"migrator-66df5d496b-csrzn\" (UID: \"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:51.652001 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.651948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwssv\" (UniqueName: \"kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv\") pod \"migrator-66df5d496b-qpv2w\" (UID: \"e3da2857-f9bf-40a6-8b02-46423bcd5516\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:51.654014 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.652716    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.663274 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.663243    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fx2ps"]
Nov 02 17:39:51.663420 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.663347    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 02 17:39:51.663420 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.663393    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fnjk8\""
Nov 02 17:39:51.679926 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.679898    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 02 17:39:51.680098 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.679988    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 02 17:39:51.680160 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.680115    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 02 17:39:51.734769 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.734730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.735016 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.734986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.735129 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.735088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdhd\" (UniqueName: \"kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.747698 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.747670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:51.804044 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.803977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:51.826111 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.826091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:51.837955 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.835601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdhd\" (UniqueName: \"kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.837955 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.835661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.837955 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.835800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.837955 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.837233    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.838603 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.838581    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.857217 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.855477    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdhd\" (UniqueName: \"kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:51.987396 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:51.987159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:52.038615 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.038581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:52.038876 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.038770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:52.038982 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.038952    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 17:39:52.039036 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.039008    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:53.038992952 +0000 UTC m=+38.505263604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : configmap "kube-rbac-proxy" not found
Nov 02 17:39:52.039271 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.039178    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:52.039271 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.039248    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:53.039229271 +0000 UTC m=+38.505499940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:52.051645 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.051615    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:39:52.057946 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:52.057907    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fad1209_655a_4176_b80f_a36b18d32310.slice/crio-aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6 WatchSource:0}: Error finding container aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6: Status 404 returned error can't find the container with id aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6
Nov 02 17:39:52.118586 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.118560    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"]
Nov 02 17:39:52.121973 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:52.121922    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdd8bd1_8fdf_4af1_8779_3a9934ac125f.slice/crio-9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287 WatchSource:0}: Error finding container 9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287: Status 404 returned error can't find the container with id 9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287
Nov 02 17:39:52.140328 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.140273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:52.140465 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.140400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:52.140465 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140448    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:52.140579 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.140494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:52.140579 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140514    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.140494881 +0000 UTC m=+45.606765538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:52.140690 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.140593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:52.140690 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140651    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:52.140784 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140708    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls podName:3ba0d151-94e7-450f-8b5d-3873a538a8a9 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.140692335 +0000 UTC m=+45.606962992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-lckhg" (UID: "3ba0d151-94e7-450f-8b5d-3873a538a8a9") : secret "cluster-monitoring-operator-tls" not found
Nov 02 17:39:52.140784 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140761    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 02 17:39:52.140784 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140778    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.140767097 +0000 UTC m=+45.607037752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : configmap references non-existent config key: service-ca.crt
Nov 02 17:39:52.140964 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.140795    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls podName:1096cec7-3002-445f-aa4a-0fe1a6f1fab8 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.140787107 +0000 UTC m=+45.607057758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-h27kn" (UID: "1096cec7-3002-445f-aa4a-0fe1a6f1fab8") : secret "samples-operator-tls" not found
Nov 02 17:39:52.147442 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.147407    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"]
Nov 02 17:39:52.150148 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:52.150115    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3da2857_f9bf_40a6_8b02_46423bcd5516.slice/crio-e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1 WatchSource:0}: Error finding container e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1: Status 404 returned error can't find the container with id e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1
Nov 02 17:39:52.241536 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.241497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:52.241757 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.241571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:52.241757 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241657    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 17:39:52.241757 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.241686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:52.241757 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241733    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls podName:60a4d219-d7c3-4dce-b7fd-fa05c2fb7943 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.241711837 +0000 UTC m=+45.707982490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls") pod "dns-default-xlnh4" (UID: "60a4d219-d7c3-4dce-b7fd-fa05c2fb7943") : secret "dns-default-metrics-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241797    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241811    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc: secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.241808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241880    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls podName:57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.241863236 +0000 UTC m=+45.708133905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls") pod "image-registry-5fb5fdd4d9-nv2tc" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf") : secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241936    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241946    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6589b9bd-vlx6x: secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241964    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.241978    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls podName:6c5488c4-85f7-46b9-923b-a2f29bf8d1d8 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.241965438 +0000 UTC m=+45.708236090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls") pod "image-registry-f6589b9bd-vlx6x" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8") : secret "image-registry-tls" not found
Nov 02 17:39:52.242042 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.242020    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:00.242005315 +0000 UTC m=+45.708275981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:52.300212 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.300065    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fx2ps"]
Nov 02 17:39:52.306966 ip-10-0-132-5 kubenswrapper[2583]: W1102 17:39:52.306893    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eabc500_70b1_45d8_82c1_c8fc8fcd6d55.slice/crio-d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e WatchSource:0}: Error finding container d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e: Status 404 returned error can't find the container with id d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e
Nov 02 17:39:52.330386 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.330296    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w" event={"ID":"e3da2857-f9bf-40a6-8b02-46423bcd5516","Type":"ContainerStarted","Data":"e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1"}
Nov 02 17:39:52.332162 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.332132    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn" event={"ID":"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f","Type":"ContainerStarted","Data":"9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287"}
Nov 02 17:39:52.334250 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.334181    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps" event={"ID":"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55","Type":"ContainerStarted","Data":"d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e"}
Nov 02 17:39:52.338509 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.338485    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" event={"ID":"7fad1209-655a-4176-b80f-a36b18d32310","Type":"ContainerStarted","Data":"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"}
Nov 02 17:39:52.338596 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.338523    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" event={"ID":"7fad1209-655a-4176-b80f-a36b18d32310","Type":"ContainerStarted","Data":"aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6"}
Nov 02 17:39:52.342071 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.341946    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:52.342916 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.342893    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/0.log"
Nov 02 17:39:52.343049 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.342931    2583 generic.go:356] "Generic (PLEG): container finished" podID="0d111045-5f11-4638-9002-179905dd2006" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87" exitCode=255
Nov 02 17:39:52.344578 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.343546    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" event={"ID":"0d111045-5f11-4638-9002-179905dd2006","Type":"ContainerDied","Data":"44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87"}
Nov 02 17:39:52.344578 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.343601    2583 scope.go:122] "RemoveContainer" containerID="9d22013b49444a3d9f10ad66b9ced37d7ed3f4c70cf8825ef5e5e70f70659570"
Nov 02 17:39:52.344578 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.343692    2583 scope.go:122] "RemoveContainer" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87"
Nov 02 17:39:52.344578 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:52.343881    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-lgcz9_openshift-console-operator(0d111045-5f11-4638-9002-179905dd2006)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" podUID="0d111045-5f11-4638-9002-179905dd2006"
Nov 02 17:39:52.362738 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:52.362681    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" podStartSLOduration=1.362663007 podStartE2EDuration="1.362663007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:52.361107751 +0000 UTC m=+37.827378442" watchObservedRunningTime="2026-11-02 17:39:52.362663007 +0000 UTC m=+37.828933683"
Nov 02 17:39:53.052379 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:53.052342    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:53.052556 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:53.052476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:53.067004 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:53.052673    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:53.067004 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:53.052751    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:55.052730364 +0000 UTC m=+40.519001018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:53.067004 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:53.053157    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 17:39:53.067004 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:53.053211    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:55.053195296 +0000 UTC m=+40.519465967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : configmap "kube-rbac-proxy" not found
Nov 02 17:39:53.352919 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:53.352611    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:53.354623 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:53.353587    2583 scope.go:122] "RemoveContainer" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87"
Nov 02 17:39:53.354623 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:53.353800    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-lgcz9_openshift-console-operator(0d111045-5f11-4638-9002-179905dd2006)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" podUID="0d111045-5f11-4638-9002-179905dd2006"
Nov 02 17:39:53.363664 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:53.363633    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps" event={"ID":"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55","Type":"ContainerStarted","Data":"72dcb8fd61bf0ef554aae4c487ffcd6927290ab4017ff97a7cc3acf601470215"}
Nov 02 17:39:54.362417 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.362342    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5tc5_7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/dns-node-resolver/0.log"
Nov 02 17:39:54.368093 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.368060    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn" event={"ID":"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f","Type":"ContainerStarted","Data":"549dfdc4b139ea67e01b2742bf634c6918b6ec09889f9a9904b0010d0ff174bf"}
Nov 02 17:39:54.369778 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.369749    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w" event={"ID":"e3da2857-f9bf-40a6-8b02-46423bcd5516","Type":"ContainerStarted","Data":"41d6fd8236b1a90471a5aef209d6bc0121449d1734b16c36a98dfa631b47f147"}
Nov 02 17:39:54.371479 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.371442    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9b9vg" event={"ID":"eacac3ba-6173-429b-a590-8e6393a738da","Type":"ContainerStarted","Data":"0f88286f1d579fd4c4a0441ac8c02e012c6e3955cd746ac8081ce7a78ed8d3ed"}
Nov 02 17:39:54.386430 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.386375    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn" podStartSLOduration=1.416012298 podStartE2EDuration="3.386361647s" totalImagesPullingTime="1.970349349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:54.386087775 +0000 UTC m=+39.852358450" watchObservedRunningTime="2026-11-02 17:39:54.386361647 +0000 UTC m=+39.852632321"
Nov 02 17:39:54.387168 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.387127    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps" podStartSLOduration=3.387117001 podStartE2EDuration="3.387117001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:53.412534556 +0000 UTC m=+38.878805231" watchObservedRunningTime="2026-11-02 17:39:54.387117001 +0000 UTC m=+39.853387674"
Nov 02 17:39:54.407300 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.407236    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9b9vg" podStartSLOduration=35.257626975 podStartE2EDuration="39.407220771s" totalImagesPullingTime="4.149593796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:39:54.406024041 +0000 UTC m=+39.872294714" watchObservedRunningTime="2026-11-02 17:39:54.407220771 +0000 UTC m=+39.873491459"
Nov 02 17:39:54.716049 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.716012    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:54.716049 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.716072    2583 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:54.716461 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:54.716447    2583 scope.go:122] "RemoveContainer" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87"
Nov 02 17:39:54.716710 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:54.716685    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-lgcz9_openshift-console-operator(0d111045-5f11-4638-9002-179905dd2006)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" podUID="0d111045-5f11-4638-9002-179905dd2006"
Nov 02 17:39:55.082037 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:55.081943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:55.082195 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:55.082087    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 17:39:55.082195 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:55.082088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:55.082195 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:55.082168    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:59.082141087 +0000 UTC m=+44.548411739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : configmap "kube-rbac-proxy" not found
Nov 02 17:39:55.082195 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:55.082185    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:55.082402 ip-10-0-132-5 kubenswrapper[2583]: E1102 17:39:55.082238    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:59.082226986 +0000 UTC m=+44.548497638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:55.375074 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:55.374991    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:55.562175 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:55.562145    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqvxr_cf4b7b16-845b-45bd-b139-62a876719b5c/node-ca/0.log"
Nov 02 17:39:55.961077 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:55.961042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t682l_203127f1-2169-422e-a508-793327fd6553/serve-healthcheck-canary/0.log"
Nov 02 17:39:56.161805 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:56.161784    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-csrzn_8cdd8bd1-8fdf-4af1-8779-3a9934ac125f/migrator/0.log"
Nov 02 17:39:56.361679 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:56.361560    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-qpv2w_e3da2857-f9bf-40a6-8b02-46423bcd5516/migrator/0.log"
Nov 02 17:39:56.379094 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:56.379064    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmrts" event={"ID":"d62c4231-ec62-436e-8eef-96bda48364c7","Type":"ContainerStarted","Data":"5fd406601a9740d48346d989613443664110bdf92ea3105b63cc728772a8027d"}
Nov 02 17:39:56.387035 ip-10-0-132-5 kubenswrapper[2583]: I1102 17:39:56.386949    2583 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 17:39:56.387128 ip-10-0-132-5 systemd[1]: Stopping Kubernetes Kubelet...
Nov 02 17:39:56.400297 ip-10-0-132-5 systemd[1]: kubelet.service: Deactivated successfully.
Nov 02 17:39:56.400471 ip-10-0-132-5 systemd[1]: Stopped Kubernetes Kubelet.
Nov 02 17:39:56.400520 ip-10-0-132-5 systemd[1]: kubelet.service: Consumed 3.238s CPU time.
Nov 02 17:39:56.412283 ip-10-0-132-5 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 17:39:56.519443 ip-10-0-132-5 kubenswrapper[5054]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:56.519443 ip-10-0-132-5 kubenswrapper[5054]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 17:39:56.519443 ip-10-0-132-5 kubenswrapper[5054]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:56.519443 ip-10-0-132-5 kubenswrapper[5054]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 17:39:56.522943 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522811    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.522943 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522942    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.522943 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522948    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522953    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522959    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522963    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522967    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522972    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522976    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522980    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522985    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522989    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522993    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.522998    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523004    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523011    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523018    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523022    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523026    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523030    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523035    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.523129 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523040    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523044    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523048    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523052    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523056    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523060    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523064    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523068    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523073    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523078    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523082    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523095    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523099    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523104    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523108    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523112    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523116    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523120    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523124    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523128    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.523601 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523133    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523137    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523141    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523145    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523150    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523154    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523158    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523162    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523166    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523172    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523177    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523181    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523185    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523189    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523194    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523198    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523203    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523207    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523211    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.524131 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523215    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523220    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523224    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523228    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523232    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523236    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523240    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523244    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523248    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523253    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523257    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523261    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523265    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523269    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523273    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523277    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523281    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523285    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523291    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.524591 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523296    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523301    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523306    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523310    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523316    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523320    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523325    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523330    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523335    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523339    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523343    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523347    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523353    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523357    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523361    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523365    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523372    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523376    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523380    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523384    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.525100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523388    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523393    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523397    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523401    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523405    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523409    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.523413    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524607    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524617    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524622    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524627    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524631    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524635    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524640    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524644    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524649    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524653    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524659    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524663    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.525573 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524667    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524671    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524675    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524680    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524684    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524690    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524696    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524701    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524705    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524709    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524713    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524718    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524722    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524726    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524730    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524734    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524738    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524743    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524747    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524751    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.526112 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524755    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524759    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524764    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524769    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524773    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524778    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524794    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524798    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524805    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524811    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524816    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524822    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524827    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524831    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524851    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524855    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524860    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524864    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524868    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.526618 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524872    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524876    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524881    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524885    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524889    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524893    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524897    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524901    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524906    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524910    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524914    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524919    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524923    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524927    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524931    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524936    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524941    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524945    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524949    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.527172 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524953    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524957    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524961    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524965    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524969    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524973    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524979    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524983    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524987    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524991    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524995    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.524999    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525003    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525007    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525011    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525015    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525019    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525023    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525027    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525031    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.527667 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525035    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525041    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525045    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525049    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525053    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525058    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525062    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525067    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525071    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525075    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525079    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525083    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525087    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525091    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525095    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525099    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525877    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525886    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525892    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525898    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.528175 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525902    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525906    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525911    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525915    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525920    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525924    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525928    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525933    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525937    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525942    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525946    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525950    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525955    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525959    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525964    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525968    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525972    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525976    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525980    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525984    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.528658 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525988    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525992    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.525996    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526001    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526005    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526009    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526013    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526017    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526028    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526032    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526036    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526043    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526048    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526053    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526057    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526062    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526066    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526070    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526074    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.529186 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526079    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526083    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526088    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526092    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526096    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526100    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526104    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526109    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526113    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526118    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526122    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526127    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526131    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526135    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526139    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526143    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526147    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526151    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526155    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.529654 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526160    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526164    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526168    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526172    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526176    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526180    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526185    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526189    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526193    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526197    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526202    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526207    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526211    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526215    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526219    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526223    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526227    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526231    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526235    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526239    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.530133 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526243    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526247    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526251    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526255    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526259    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526263    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526267    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526271    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526275    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526279    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526283    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526291    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526298    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526302    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526307    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526311    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526315    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526319    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526323    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.530629 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526334    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526338    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526343    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526347    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.526351    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526475    5054 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526485    5054 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526493    5054 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526499    5054 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526506    5054 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526511    5054 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526518    5054 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526524    5054 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526528    5054 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526533    5054 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526538    5054 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526543    5054 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526548    5054 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526553    5054 flags.go:64] FLAG: --cgroup-root=""
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526557    5054 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526562    5054 flags.go:64] FLAG: --client-ca-file=""
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526566    5054 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526571    5054 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526586    5054 flags.go:64] FLAG: --cluster-domain=""
Nov 02 17:39:56.531177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526591    5054 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526596    5054 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526601    5054 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526606    5054 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526612    5054 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526616    5054 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526621    5054 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526627    5054 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526632    5054 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526638    5054 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526642    5054 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526647    5054 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526652    5054 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526658    5054 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526663    5054 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526668    5054 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526672    5054 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526677    5054 flags.go:64] FLAG: --enable-server="true"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526682    5054 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526691    5054 flags.go:64] FLAG: --event-burst="100"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526696    5054 flags.go:64] FLAG: --event-qps="50"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526701    5054 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526706    5054 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526711    5054 flags.go:64] FLAG: --eviction-hard=""
Nov 02 17:39:56.531756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526717    5054 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526722    5054 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526726    5054 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526731    5054 flags.go:64] FLAG: --eviction-soft=""
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526743    5054 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526748    5054 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526753    5054 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526758    5054 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526762    5054 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526767    5054 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526772    5054 flags.go:64] FLAG: --feature-gates=""
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526782    5054 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526787    5054 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526791    5054 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526797    5054 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526802    5054 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526807    5054 flags.go:64] FLAG: --help="false"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526812    5054 flags.go:64] FLAG: --hostname-override="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526821    5054 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526827    5054 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526851    5054 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526857    5054 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526863    5054 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 17:39:56.532420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526868    5054 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526873    5054 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526877    5054 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526882    5054 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526887    5054 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526892    5054 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526897    5054 flags.go:64] FLAG: --kube-reserved=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526902    5054 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526906    5054 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526911    5054 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526916    5054 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526921    5054 flags.go:64] FLAG: --lock-file=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526926    5054 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526930    5054 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526935    5054 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526944    5054 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526949    5054 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526953    5054 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526958    5054 flags.go:64] FLAG: --logging-format="text"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526963    5054 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526968    5054 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526973    5054 flags.go:64] FLAG: --manifest-url=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526978    5054 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526985    5054 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526990    5054 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 17:39:56.533080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.526996    5054 flags.go:64] FLAG: --max-pods="110"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527001    5054 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527005    5054 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527011    5054 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527017    5054 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527021    5054 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527026    5054 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527030    5054 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527040    5054 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527045    5054 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527049    5054 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527054    5054 flags.go:64] FLAG: --pod-cidr=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527059    5054 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527063    5054 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527068    5054 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527073    5054 flags.go:64] FLAG: --port="10250"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527077    5054 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527082    5054 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0e561b5ed6c4a67d9"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527087    5054 flags.go:64] FLAG: --qos-reserved=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527092    5054 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527096    5054 flags.go:64] FLAG: --register-node="true"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527101    5054 flags.go:64] FLAG: --register-with-taints=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527106    5054 flags.go:64] FLAG: --registry-burst="10"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527111    5054 flags.go:64] FLAG: --registry-qps="5"
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527116    5054 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527120    5054 flags.go:64] FLAG: --reserved-memory=""
Nov 02 17:39:56.533678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527126    5054 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527131    5054 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527136    5054 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527141    5054 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527145    5054 flags.go:64] FLAG: --runonce="false"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527150    5054 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527155    5054 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527159    5054 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527164    5054 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527169    5054 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527175    5054 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527180    5054 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527185    5054 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527191    5054 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527195    5054 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527200    5054 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527204    5054 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527209    5054 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527214    5054 flags.go:64] FLAG: --system-cgroups=""
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527218    5054 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527226    5054 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527231    5054 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527235    5054 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527242    5054 flags.go:64] FLAG: --tls-min-version=""
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527247    5054 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 17:39:56.534312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527251    5054 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527256    5054 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527260    5054 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527265    5054 flags.go:64] FLAG: --v="2"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527271    5054 flags.go:64] FLAG: --version="false"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527277    5054 flags.go:64] FLAG: --vmodule=""
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527283    5054 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.527288    5054 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527506    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527511    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527516    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527520    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527524    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527529    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527533    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527537    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527541    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527548    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527552    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527557    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527561    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.534926 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527567    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527573    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527578    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527583    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527587    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527592    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527597    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527602    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527606    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527610    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527614    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527619    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527623    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527627    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527631    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527635    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527640    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527644    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527648    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527653    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.535428 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527657    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527661    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527665    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527670    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527674    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527679    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527683    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527687    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527693    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527697    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527701    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527706    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527710    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527714    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527719    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527723    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527727    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527731    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527735    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527739    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.535936 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527745    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527749    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527753    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527757    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527762    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527766    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527770    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527774    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527778    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527782    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527786    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527791    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527795    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527799    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527803    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527807    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527811    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527815    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527822    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527828    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.536429 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527850    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527855    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527862    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527868    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527872    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527876    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527880    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527884    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527888    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527892    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527896    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527900    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527904    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527909    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527913    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527917    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527921    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527925    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527929    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.537070 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527933    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527937    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527941    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527945    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527949    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527953    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527957    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527961    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527965    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527969    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527973    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527977    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527981    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.527986    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.528024    5054 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528079    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.537767 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528085    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528090    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528094    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528098    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528102    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528106    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528110    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528115    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528119    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528123    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528127    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528132    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528137    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528141    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528145    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528149    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528153    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528157    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528162    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528166    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.538347 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528170    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528174    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528178    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528183    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528189    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528195    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528200    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528205    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528209    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528214    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528220    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528226    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528230    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528235    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528243    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528247    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528251    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528255    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528259    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.538945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528263    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528267    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528272    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528276    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528280    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528284    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528288    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528292    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528296    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528300    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528304    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528309    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528313    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528317    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528321    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528325    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528329    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528333    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528338    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528342    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.539507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528346    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528350    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528354    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528360    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528369    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528374    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528380    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528384    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528389    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528393    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528397    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528401    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528405    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528409    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528414    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528418    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528422    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528426    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528430    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528435    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.540100 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528439    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528443    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528447    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528454    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528460    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528466    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528470    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528475    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528479    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528484    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528488    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528492    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528496    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528500    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528504    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528509    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528515    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528520    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528524    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.541045 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528528    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528534    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528538    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528543    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528547    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528551    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.528555    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.532419    5054 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.532435    5054 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.532453    5054 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.532458    5054 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532514    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532519    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532523    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532527    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532530    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532533    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532535    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532538    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532541    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.541765 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532544    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532546    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532549    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532552    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532554    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532557    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532560    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532562    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532565    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532567    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532570    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532573    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532575    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532578    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532581    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532585    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532587    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532590    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532592    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532595    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.542450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532599    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532601    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532604    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532607    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532609    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532612    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532615    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532617    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532619    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532622    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532625    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532627    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532630    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532632    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532635    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532639    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532643    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532646    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532648    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.543069 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532651    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532654    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532657    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532659    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532662    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532664    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532667    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532670    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532673    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532675    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532678    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532681    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532683    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532686    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532689    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532692    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532694    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532697    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532699    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532702    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.543586 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532704    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532707    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532709    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532712    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532714    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532717    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532719    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532722    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532724    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532728    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532731    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532734    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532737    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532740    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532742    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532745    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532747    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532750    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532753    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.544085 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532755    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532758    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532760    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532763    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532766    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532768    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532771    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532773    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532776    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532779    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532781    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532784    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532786    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532789    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532791    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532794    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532796    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532799    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.544532 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.532802    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.532829    5054 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533007    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533011    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533014    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533017    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533020    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533023    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533026    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533029    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533032    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533035    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533038    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533041    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533043    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533045    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.544973 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533050    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533053    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533056    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533059    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533062    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533064    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533067    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533070    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533073    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533075    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533078    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533081    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533083    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533086    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533089    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533092    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533094    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533097    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533100    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.545450 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533102    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533105    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533107    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533110    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533112    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533115    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533117    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533120    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533122    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533125    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533127    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533130    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533133    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533135    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533138    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533140    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533143    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533145    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533148    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533150    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.546007 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533153    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533156    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533158    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533161    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533163    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533166    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533168    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533172    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533174    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533177    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533180    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533182    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533185    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533187    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533190    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533192    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533195    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533197    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533200    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.546497 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533202    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533205    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533207    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533211    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533213    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533216    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533218    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533221    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533223    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533226    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533228    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533231    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533233    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533236    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533239    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533244    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533247    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533249    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533252    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533255    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.547020 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533257    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533259    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533262    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533264    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533267    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533269    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533273    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533277    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533280    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533282    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533285    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533290    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533292    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533295    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.533318    5054 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 17:39:56.547503 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533354    5054 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533358    5054 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533362    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533364    5054 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533367    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533369    5054 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533372    5054 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533375    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533377    5054 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533380    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533383    5054 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533386    5054 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533388    5054 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533391    5054 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533394    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533397    5054 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533399    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533402    5054 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533405    5054 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 17:39:56.547901 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533408    5054 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533410    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533413    5054 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533415    5054 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533418    5054 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533420    5054 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533423    5054 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533425    5054 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533428    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533431    5054 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533435    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533438    5054 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533440    5054 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533443    5054 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533446    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533448    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533451    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533453    5054 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533456    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 17:39:56.548402 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533458    5054 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533461    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533464    5054 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533466    5054 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533469    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533472    5054 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533474    5054 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533477    5054 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533480    5054 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533483    5054 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533486    5054 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533489    5054 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533491    5054 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533494    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533496    5054 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533499    5054 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533501    5054 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533504    5054 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533506    5054 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533510    5054 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 17:39:56.548877 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533514    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533517    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533519    5054 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533523    5054 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533526    5054 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533529    5054 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533532    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533536    5054 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533540    5054 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533544    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533548    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533551    5054 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533558    5054 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533561    5054 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533576    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533579    5054 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533582    5054 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533585    5054 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533587    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533590    5054 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 17:39:56.549369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533592    5054 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533597    5054 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533601    5054 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533604    5054 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533607    5054 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533609    5054 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533612    5054 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533614    5054 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533617    5054 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533619    5054 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533622    5054 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533625    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533627    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533630    5054 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533632    5054 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533636    5054 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533639    5054 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533641    5054 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533644    5054 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 17:39:56.549865 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533647    5054 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533649    5054 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533652    5054 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533654    5054 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533658    5054 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533662    5054 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533664    5054 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533667    5054 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:56.533669    5054 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.533726    5054 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.534691    5054 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.534750    5054 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.534954    5054 server.go:1014] "Starting client certificate rotation"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.535098    5054 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.535157    5054 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 17:34:14 +0000 UTC" deadline="2028-04-16 00:54:48.571333404 +0000 UTC"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.535202    5054 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12727h14m52.036134086s"
Nov 02 17:39:56.550340 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.535440    5054 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 17:39:56.550907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.536506    5054 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 17:39:56.550907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.539614    5054 log.go:25] "Validated CRI v1 runtime API"
Nov 02 17:39:56.550907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.541713    5054 log.go:25] "Validated CRI v1 image API"
Nov 02 17:39:56.550907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.542607    5054 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 17:39:56.550907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.544625    5054 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81792f29-8c4b-4f46-a876-6e2912bdf72f:/dev/nvme0n1p3 86bef26d-33d6-41a3-9e10-2a214a5fb62f:/dev/nvme0n1p4]
Nov 02 17:39:56.551125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.544645    5054 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8c296e1d0ee99a2348802922581094870cfe50d1b2d7f3b893e2598a1832c1f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8c296e1d0ee99a2348802922581094870cfe50d1b2d7f3b893e2598a1832c1f/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c8d04333d1d35afc29f2663396074f5274e617bc8ae0887ca0a488f9c596c9b8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c8d04333d1d35afc29f2663396074f5274e617bc8ae0887ca0a488f9c596c9b8/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e5306838b0b34134bacf8ac9fa316b8bf2d1303ad42260edb4f0a082e571a96f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e5306838b0b34134bacf8ac9fa316b8bf2d1303ad42260edb4f0a082e571a96f/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~projected/kube-api-access-cjwkt:{mountpoint:/var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~projected/kube-api-access-cjwkt major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1096cec7-3002-445f-aa4a-0fe1a6f1fab8/volumes/kubernetes.io~projected/kube-api-access-xpz78:{mountpoint:/var/lib/kubelet/pods/1096cec7-3002-445f-aa4a-0fe1a6f1fab8/volumes/kubernetes.io~projected/kube-api-access-xpz78 major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~projected/kube-api-access-78sjv:{mountpoint:/var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~projected/kube-api-access-78sjv major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~secret/serving-cert major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~projected/kube-api-access-qml5k:{mountpoint:/var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~projected/kube-api-access-qml5k major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~secret/cert major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20498905-a7ee-4693-af66-069c9fe67f64/volumes/kubernetes.io~projected/kube-api-access-5vjzj:{mountpoint:/var/lib/kubelet/pods/20498905-a7ee-4693-af66-069c9fe67f64/volumes/kubernetes.io~projected/kube-api-access-5vjzj major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2149ddc6-1523-41b7-8f17-2dd5f85a7825/volumes/kubernetes.io~projected/kube-api-access-kt4fn:{mountpoint:/var/lib/kubelet/pods/2149ddc6-1523-41b7-8f17-2dd5f85a7825/volumes/kubernetes.io~projected/kube-api-access-kt4fn major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ba0d151-94e7-450f-8b5d-3873a538a8a9/volumes/kubernetes.io~projected/kube-api-access-5ldb6:{mountpoint:/var/lib/kubelet/pods/3ba0d151-94e7-450f-8b5d-3873a538a8a9/volumes/kubernetes.io~projected/kube-api-access-5ldb6 major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~projected/kube-api-access-jbdhd:{mountpoint:/var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~projected/kube-api-access-jbdhd major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~secret/signing-key major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~projected/kube-api-access-q452d:{mountpoint:/var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~projected/kube-api-access-q452d major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~secret/serving-cert major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/kube-api-access-8f7nz:{mountpoint:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/kube-api-access-8f7nz major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d2d7655-ead5-46f0-9837-9cb4a2671721/volumes/kubernetes.io~projected/kube-api-access-zhszd:{mountpoint:/var/lib/kubelet/pods/5d2d7655-ead5-46f0-9837-9cb4a2671721/volumes/kubernetes.io~projected/kube-api-access-zhszd major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/volumes/kubernetes.io~projected/kube-api-access-59qm4:{mountpoint:/var/lib/kubelet/pods/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/volumes/kubernetes.io~projected/kube-api-access-59qm4 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~projected/kube-api-access-kx8nd:{mountpoint:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~projected/kube-api-access-kx8nd major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/default-certificate major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/stats-auth major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/kube-api-access-zvfhb:{mountpoint:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/kube-api-access-zvfhb major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4/volumes/kubernetes.io~projected/kube-api-access-cq8vt:{mountpoint:/var/lib/kubelet/pods/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4/volumes/kubernetes.io~projected/kube-api-access-cq8vt major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/volumes/kubernetes.io~projected/kube-api-access-rr5t9:{mountpoint:/var/lib/kubelet/pods/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/volumes/kubernetes.io~projected/kube-api-access-rr5t9 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7fad1209-655a-4176-b80f-a36b18d32310/volumes/kubernetes.io~projected/kube-api-access-gcgx7:{mountpoint:/var/lib/kubelet/pods/7fad1209-655a-4176-b80f-a36b18d32310/volumes/kubernetes.io~projected/kube-api-access-gcgx7 major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~projected/kube-api-access-pps24:{mountpoint:/var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~projected/kube-api-access-pps24 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f/volumes/kubernetes.io~projected/kube-api-access-mln9g:{mountpoint:/var/lib/kubelet/pods/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f/volumes/kubernetes.io~projected/kube-api-access-mln9g major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cc3e86b-8f7d-44da-8227-1240cf3b4167/volumes/kubernetes.io~projected/kube-api-access-8ljk8:{mountpoint:/var/lib/kubelet/pods/9cc3e86b-8f7d-44da-8227-1240cf3b4167/volumes/kubernetes.io~projected/kube-api-access-8ljk8 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af88b340-3cce-4031-8251-e39cedaf0916/volumes/kubernetes.io~projected/kube-api-access-bd7hv:{mountpoint:/var/lib/kubelet/pods/af88b340-3cce-4031-8251-e39cedaf0916/volumes/kubernetes.io~projected/kube-api-access-bd7hv major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~projected/kube-api-access-x26cd:{mountpoint:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~projected/kube-api-access-x26cd major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~projected/kube-api-access-vxm5d:{mountpoint:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~projected/kube-api-access-vxm5d major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c660205d-a64f-4693-9175-dc3d82e75ecc/volumes/kubernetes.io~projected/kube-api-access-6pgzf:{mountpoint:/var/lib/kubelet/pods/c660205d-a64f-4693-9175-dc3d82e75ecc/volumes/kubernetes.io~projected/kube-api-access-6pgzf major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf4b7b16-845b-45bd-b139-62a876719b5c/volumes/kubernetes.io~projected/kube-api-access-4fg84:{mountpoint:/var/lib/kubelet/pods/cf4b7b16-845b-45bd-b139-62a876719b5c/volumes/kubernetes.io~projected/kube-api-access-4fg84 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d125ccb7-dd74-43c4-8bdf-970121de6423/volumes/kubernetes.io~projected/kube-api-access-vpw8p:{mountpoint:/var/lib/kubelet/pods/d125ccb7-dd74-43c4-8bdf-970121de6423/volumes/kubernetes.io~projected/kube-api-access-vpw8p major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d62c4231-ec62-436e-8eef-96bda48364c7/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/d62c4231-ec62-436e-8eef-96bda48364c7/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc5bbef7-9279-44d0-b1fb-0dd242c10b88/volumes/kubernetes.io~projected/kube-api-access-t2bzr:{mountpoint:/var/lib/kubelet/pods/dc5bbef7-9279-44d0-b1fb-0dd242c10b88/volumes/kubernetes.io~projected/kube-api-access-t2bzr major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2978e7a-385f-4edb-8bac-e691bb7e8c69/volumes/kubernetes.io~projected/kube-api-access-kclwt:{mountpoint:/var/lib/kubelet/pods/e2978e7a-385f-4edb-8bac-e691bb7e8c69/volumes/kubernetes.io~projected/kube-api-access-kclwt major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2e9f10a-d472-47de-bb6d-fe29d2285945/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/e2e9f10a-d472-47de-bb6d-fe29d2285945/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3da2857-f9bf-40a6-8b02-46423bcd5516/volumes/kubernetes.io~projected/kube-api-access-xwssv:{mountpoint:/var/lib/kubelet/pods/e3da2857-f9bf-40a6-8b02-46423bcd5516/volumes/kubernetes.io~projected/kube-api-access-xwssv major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eacac3ba-6173-429b-a590-8e6393a738da/volumes/kubernetes.io~projected/kube-api-access-26cq6:{mountpoint:/var/lib/kubelet/pods/eacac3ba-6173-429b-a590-8e6393a738da/volumes/kubernetes.io~projected/kube-api-access-26cq6 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff0f3fcf-4203-4f41-b835-07eb54829bc3/volumes/kubernetes.io~projected/kube-api-access-m2f8f:{mountpoint:/var/lib/kubelet/pods/ff0f3fcf-4203-4f41-b835-07eb54829bc3/volumes/kubernetes.io~projected/kube-api-access-m2f8f major:0 minor:67 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/382b4b731e1133739ee358b2fc0076c3ab7e7504e67ab8b46425ec2c55bda624/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/78c65be20c21d71c4d40d0a016eccf18f9f6d8e8f3b4b0395e0c243359694dcb/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/55e7fcce18c230e8e9662db2e6572b97a69c82e08e454699eaa3dfdc25b9f4d7/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/eccd25f998688e003108bd9b9cc1aae1e28549e71bfba616059ba491225107fa/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4ba916a7ecb8ec82c9acf642eb2724cb5d979f27f4dd176cc6164109f307937f/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/85ff3d66097161b8a7a524b7f13fce541506d95d2b9eeb7539ff4e143e5abcc5/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/7bb9b96fe7b587648bf2a33a83d5e6c61a1393ea013a1a0a419b1efa6a9750c5/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/62a1e18cb6f593c35e068b34a6aa2edbe3c35442cbbe85a0267dcf2b737c7f29/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/b328c7b47cdd7f6f154c1528afe73ceabb45485785bf11fa0185976ff6d8a061/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/bf6df97f6d14ea4b2a5408094e3a8da61e2dc7ebf553638fafe13b8de31209d6/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/1b65433c4e2c40878a96934814ab2f20b69ec50da0395e66eaddc094f357e758/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/9138cccf6b8ca34e01386990a18541cee01ec19e530caf32ea71ac91b4764360/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/d0e2ed3988e6e9fb134cf9bced1e0fd7e0c630172d25e7171bb7417672fd2d98/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/eb5647c07adbbd71f4e7f68675c40402c813e56a0286757b30da92946eb09f6d/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8d0ef4bea639ce6d100e60891301e4f7569b0e22787bc66d46999fac02195727/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/e696f85a893dadca2abdf7452851321ea544196652c0826968ebc685775a1d5a/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/f269ce4bd9fb948bce23af38b8bf9fde638f5ea46283219c5c066190f38216a2/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/c75d9f63be6a5e7f325e06d80b1b96244a0e5630e0a81c0fed298b2f186561d8/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/4e4dd79f1151d8b41eb0fffc408229328216555ee4fb10e57f9130a335da8b18/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/8541ce9b02c0ce39e1f9b3ea0947a1ce36f2d1efb0b85f5bac3243f86a8ac00f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/bda309651b6202e210863b20d837ce56da55d4cdb3e042caf4e1a4d0a3e62f0b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/e849b86e0458bd4243597fd48d0e2ad5ce2d973f07277297f7fd86f2029a4f87/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/e3d48f8ded0b5fa501524ff23a12e43693382bc493c169881e195e4a274c37cf/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/59ee8c69abb711d55ab731b2141725a06afe5bd8f4109e5821e9cfb183f6c7c4/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/3f3a9ff714098ae14017b302f3892082f4088823e3f3a089cf4ba466180f1f84/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/86821a59a3fd1e5de6e2190325f401d2a328458ff6da31c036a7aa21caa1931a/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/bab3e4c2dba9993e6ae0523ea947bb2bc82b0b49cb65c81bd96acf154e6016a3/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/40965c1a9789a4fa641b091de2b977c89a1d3d8869be1cfa410826696dfd2cc2/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/272859a40ce55f710c623f97bbe63abd8a5344d23a096be90bf37f1265725365/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/627c22327b25e39fd0ca00f5a7c7ec35fdcf0082cf24e5f43f59d964bc8ff4e8/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/5f362e790c7065f3d2ce9ce48574611530dbb3cf17e6f9ddbd659acd27c3253e/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/88ff29be286fb38f54e6c80ab68fa7959dbfe1dbb9b5490180d180a40e40d22d/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/5b80476e62c6a8f728b95565425e117861860277cdeb5f7d29a5fb927b20a70d/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/c197667f7337ef81dff07e874aba6a200abdf6acde9fd4477ca3f438376b70f8/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/c3ed97cae988c97230a10ccf833a4b6f06a1dd4d0d4ddafe3ba865c157dfe256/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/979d8ad0a5625d8f21b68847bbd9bf100092c994ce21915716df60c50b854703/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/0e53233964ebbf7bef5b57d1383ec593499efa221dfcd20432b3ff0a3d0c4de8/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/c48f40a6ef87bdf04c1431a61b9ac74fece63defeddf13084dce11f7fb1f0210/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/b3f79796e8a04c6215d7edd4f05a1876a4ee60bac2d27dce6e4957999ed58b3e/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/76996b81db36a0f619ba66269778a11b24df0dcb21536c6078c345d33c67dc2a/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/a72650b3db9c01c77a6ea9c1892ea97d2e9c7d6b64510a703357177b97980ba4/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/fe2b892744d3a6bf86acd9110305822f969d01c01adfd074d5a9f84cd0a9fc96/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/e53fe3bd7d9f682358f9fd2f3fbc82fc5a5b13a82ee3406c85e7caf4d3d9ad27/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/b43dd94783c11ee7b65b50487453f09cd782650da1572e10e3924d47fe092d79/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/1cb79a61c816a7e34f8c4e410fc463a4b11565901b903cb7c97a3128db58e9cf/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/c65eca1806e10befc8f0248ea8ab629ade8620521cf68fa0cedbc4eb5a903b19/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/2a11ed243c9ac55dc78e781cb213113269514d7f99300f1830bfe804002fa837/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/5cfd2b30a0d9a7375da742816c41a014391a66eb1045cc59cacd0c6089174c71/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/3ca2a6021136991642bc85b5823aacdd204924cadb11c355f087ffc0637c31d6/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/fde02b9a6a1a5fcf7732346d8f87628f86b2e016ba8396c908f6ceaca79de658/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/8b1214bdb2d4842a7cc30753cda492a397152f408696f8ea8b0ce3d5b862a32c/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/49b3e3002853fb4b1542a9df1c7e37d3273e6a6816733f73244f0b30894ce065/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/d243c77da3600506af275bddff5e73383041a21d47a1761c7136e3b35f2c732e/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/b029ea7e3f4b66ebb572a35c1a46f6f55ce582d41b9489cf76bf40f77aac10b1/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/9cfa043fb4ff0ee00e74d3a1ebc62578342aace6fc759115ba91029b3fc08682/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/8abe50fe24fa5e3bfd4f241c41c9870351cdd17ced0615eedbcbbd69d9f7e685/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/2bc5b645af566585548f2c6510ac9f0e46fd40ba9b82621d22db73a0dee49055/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/10cce9a04d6cb59102c593bbd03e028884327c01cbadf60428122ddd6e70ce5e/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/844944f5693d8e5268707529c717dcfca7d1d2c9cf9e11477a28202814f72b52/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/6b549901b20c3345970e77f1b187e27b8e42695a6fa82d10c506eccce5eea8ea/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/4a0b18024cbff40f96d92d0e433a3b3430855145975f7814d555d08d03243c0f/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/36aa59561a86cc722285ac5dc7cc4a5d78330b2e7bb5ea787d051df5cb9aa353/merged major:0 minor:98 fsType:overlay blockSize:0}]
Nov 02 17:39:56.552976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.552612    5054 manager.go:217] Machine: {Timestamp:2026-11-02 17:39:56.552133604 +0000 UTC m=+0.060895662 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3126626 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e8d149d8a92f32668b4f5e1bcd49 SystemUUID:ec26e8d1-49d8-a92f-3266-8b4f5e1bcd49 BootID:8cac69c5-2ba7-413a-8d13-2a10b782cdd0 Filesystems:[{Device:/run/containers/storage/overlay-containers/92d48025ea5937ef9f692ff798c335ae0a6295b0788565c03bab4cca5239031e/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2978e7a-385f-4edb-8bac-e691bb7e8c69/volumes/kubernetes.io~projected/kube-api-access-kclwt DeviceMajor:0 DeviceMinor:210 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:213 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20498905-a7ee-4693-af66-069c9fe67f64/volumes/kubernetes.io~projected/kube-api-access-5vjzj DeviceMajor:0 DeviceMinor:335 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d125ccb7-dd74-43c4-8bdf-970121de6423/volumes/kubernetes.io~projected/kube-api-access-vpw8p DeviceMajor:0 DeviceMinor:205 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1752cb5ac7d473e856942a9d95f132b57ca0945bed1e6768b30523f2e4fd58e/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:214 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/af88b340-3cce-4031-8251-e39cedaf0916/volumes/kubernetes.io~projected/kube-api-access-bd7hv DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~projected/kube-api-access-cjwkt DeviceMajor:0 DeviceMinor:211 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~projected/kube-api-access-x26cd DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~projected/kube-api-access-78sjv DeviceMajor:0 DeviceMinor:221 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/02773d800f055810611413c6c86d17e0a1e2ff93c099ed8f7b8a2ac0aa079eda/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6f73462be8ef121098183d43c6ff35ded794690075787aed79b6e5a3030c38b6/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e5306838b0b34134bacf8ac9fa316b8bf2d1303ad42260edb4f0a082e571a96f/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/volumes/kubernetes.io~projected/kube-api-access-rr5t9 DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:218 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c660205d-a64f-4693-9175-dc3d82e75ecc/volumes/kubernetes.io~projected/kube-api-access-6pgzf DeviceMajor:0 DeviceMinor:206 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8d5ccc1a454a44647de7982c0a5bedbff7b0fe886fb58965946a0efac000d5f/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~projected/kube-api-access-jbdhd DeviceMajor:0 DeviceMinor:341 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38b4c324786cf98c7129e2d8262dd47b6800c201807f76a4ef3783f1a45e6382/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/193ceab3ad4f4017df4f59f3e88e05f5b7f3811c43655d55944e13d4b018b1ce/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c8d04333d1d35afc29f2663396074f5274e617bc8ae0887ca0a488f9c596c9b8/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/203127f1-2169-422e-a508-793327fd6553/volumes/kubernetes.io~projected/kube-api-access-qml5k DeviceMajor:0 DeviceMinor:225 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e3da2857-f9bf-40a6-8b02-46423bcd5516/volumes/kubernetes.io~projected/kube-api-access-xwssv DeviceMajor:0 DeviceMinor:329 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf4b7b16-845b-45bd-b139-62a876719b5c/volumes/kubernetes.io~projected/kube-api-access-4fg84 DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~projected/kube-api-access-pps24 DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e424ab6bc0f21e0063bbd57d81088eb0f16c9ddb3fb3fd5bca572ab33d356cf1/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7fad1209-655a-4176-b80f-a36b18d32310/volumes/kubernetes.io~projected/kube-api-access-gcgx7 DeviceMajor:0 DeviceMinor:334 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b14a0a20-b96d-426d-821a-4b5befbaa1d5/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/85ca2f8a-a233-42ed-87be-78984e39ee6f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/442db46e-32cb-4277-a51c-fae4c064c817/volumes/kubernetes.io~projected/kube-api-access-q452d DeviceMajor:0 DeviceMinor:219 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/kube-api-access-8f7nz DeviceMajor:0 DeviceMinor:228 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:339 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/kube-api-access-zvfhb DeviceMajor:0 DeviceMinor:223 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e4cf2b533402ef259f93ca48e0ae4a5078fa847a1b7b71964894057bec3fbbe1/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d62c4231-ec62-436e-8eef-96bda48364c7/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:272 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/volumes/kubernetes.io~projected/kube-api-access-vxm5d DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/volumes/kubernetes.io~projected/kube-api-access-59qm4 DeviceMajor:0 DeviceMinor:226 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ee41433632a5495952176ccc9e8bf4d72f7488a3a392466702228ac02cb9ec3/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2149ddc6-1523-41b7-8f17-2dd5f85a7825/volumes/kubernetes.io~projected/kube-api-access-kt4fn DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1520f556-1207-43c4-afad-fe19f9bbf7c0/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:217 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:220 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3dfc3a2d00dd16ea4286ec356f349246c19a9a8a3e34752de1d9e4f2b83d2e3c/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/accfe8b64cc3a65de517cd81ff368b2cf09e4b8ad242b0f441ec858daa242729/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c620fae21e5a558196fd0c613a2d38a9716c88f94ca828e66c101b960c011c6/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/63887114-eb90-460e-a7ed-a4bf04e4fea6/volumes/kubernetes.io~projected/kube-api-access-kx8nd DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eacac3ba-6173-429b-a590-8e6393a738da/volumes/kubernetes.io~projected/kube-api-access-26cq6 DeviceMajor:0 DeviceMinor:293 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f/volumes/kubernetes.io~projected/kube-api-access-mln9g DeviceMajor:0 DeviceMinor:312 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e28fdea8bc52bc5e73e1037d2797e8f9dd4f68ff40ba87cff3fd14d1cbe8652f/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/60d1be2595869dc1828ac5854570053ddf2a7908a59bfc66ca4f1f178f676c62/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ff0f3fcf-4203-4f41-b835-07eb54829bc3/volumes/kubernetes.io~projected/kube-api-access-m2f8f DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6b88b020b44042a15f349348301945265c77f7dcd8cf2158764a43924055861a/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0d111045-5f11-4638-9002-179905dd2006/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3ba0d151-94e7-450f-8b5d-3873a538a8a9/volumes/kubernetes.io~projected/kube-api-access-5ldb6 DeviceMajor:0 DeviceMinor:207 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/dc5bbef7-9279-44d0-b1fb-0dd242c10b88/volumes/kubernetes.io~projected/kube-api-access-t2bzr DeviceMajor:0 DeviceMinor:208 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9db69e621bd71cce1e2136c37212844b1716164b19a4bf728cec0684323bf287/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9cc3e86b-8f7d-44da-8227-1240cf3b4167/volumes/kubernetes.io~projected/kube-api-access-8ljk8 DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1096cec7-3002-445f-aa4a-0fe1a6f1fab8/volumes/kubernetes.io~projected/kube-api-access-xpz78 DeviceMajor:0 DeviceMinor:209 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:227 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d602e5e9c0c9f113272d095cd972a09106e5a099a4ca63d1e6d15428d1e2895d/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4/volumes/kubernetes.io~projected/kube-api-access-cq8vt DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:215 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:216 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8c296e1d0ee99a2348802922581094870cfe50d1b2d7f3b893e2598a1832c1f/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c7e45137d0f85c76a30370a86c1284cfef1b43e2cd9caaaf2f0fc167782cd7e/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2e9f10a-d472-47de-bb6d-fe29d2285945/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa36a2f234999959b950b6f55a6cc54c350f66938f65a9a4d04632af6721d496/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5d2d7655-ead5-46f0-9837-9cb4a2671721/volumes/kubernetes.io~projected/kube-api-access-zhszd DeviceMajor:0 DeviceMinor:222 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:212 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:02773d800f05581 MacAddress:da:36:00:4b:00:93 Speed:10000 Mtu:8901} {Name:0c7e45137d0f85c MacAddress:0a:1f:cd:62:40:53 Speed:10000 Mtu:8901} {Name:1ee41433632a549 MacAddress:22:6f:da:83:a6:78 Speed:10000 Mtu:8901} {Name:3dfc3a2d00dd16e MacAddress:5a:1e:a9:d3:09:d0 Speed:10000 Mtu:8901} {Name:6f73462be8ef121 MacAddress:b2:69:fc:4b:cb:f9 Speed:10000 Mtu:8901} {Name:9db69e621bd71cc MacAddress:be:1f:1a:bb:a3:89 Speed:10000 Mtu:8901} {Name:a8d5ccc1a454a44 MacAddress:02:e2:f7:b2:b9:36 Speed:10000 Mtu:8901} {Name:aac6633f991668f MacAddress:92:37:4c:0c:ef:67 Speed:10000 Mtu:8901} {Name:accfe8b64cc3a65 MacAddress:be:3a:93:41:20:2d Speed:10000 Mtu:8901} {Name:b8c296e1d0ee99a MacAddress:9e:a8:70:41:f9:51 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c4:79:a8:b3 Speed:0 Mtu:9001} {Name:br-int MacAddress:c2:67:db:49:33:9f Speed:0 Mtu:8901} {Name:c8d04333d1d35af MacAddress:92:ab:0a:a2:b3:41 Speed:10000 Mtu:8901} {Name:d1752cb5ac7d473 MacAddress:36:62:16:b5:34:92 Speed:10000 Mtu:8901} {Name:d602e5e9c0c9f11 MacAddress:5e:81:6c:d2:8d:50 Speed:10000 Mtu:8901} {Name:e424ab6bc0f21e0 MacAddress:ea:cb:5a:f6:47:e9 Speed:10000 Mtu:8901} {Name:e4cf2b533402ef2 MacAddress:ea:30:00:7e:db:2a Speed:10000 Mtu:8901} {Name:e5306838b0b3413 MacAddress:2e:a0:6b:4c:25:d3 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c4:79:a8:b3 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:be:10:da:43:36:4f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:fe:74:de:f5:9d:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 17:39:56.553224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.552979    5054 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 17:39:56.553224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553023    5054 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 17:39:56.553354 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553331    5054 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 17:39:56.553543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553358    5054 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-5.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 17:39:56.553584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553547    5054 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 17:39:56.553584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553560    5054 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 17:39:56.553584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553578    5054 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 17:39:56.553666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553603    5054 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 17:39:56.553666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553628    5054 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 17:39:56.553831 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553820    5054 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 17:39:56.553990 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.553979    5054 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 17:39:56.554033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.554024    5054 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 17:39:56.554062 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.554045    5054 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 17:39:56.554062 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.554060    5054 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 17:39:56.554142 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.554073    5054 kubelet.go:405] "Adding apiserver pod source"
Nov 02 17:39:56.554142 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.554084    5054 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 17:39:56.555804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.555633    5054 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 17:39:56.555804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.555653    5054 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 17:39:56.556643 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.556600    5054 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 17:39:56.559175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559159    5054 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 17:39:56.559175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559173    5054 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 17:39:56.559276 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559263    5054 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 02 17:39:56.559452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559441    5054 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 17:39:56.559486 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559470    5054 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 17:39:56.559577 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559567    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 17:39:56.559606 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559581    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 17:39:56.559606 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559588    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 17:39:56.559606 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559594    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 17:39:56.559606 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559599    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 17:39:56.559606 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559605    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559612    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559692    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559711    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559721    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559734    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559749    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559773    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 17:39:56.559791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.559779    5054 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 17:39:56.564052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.563517    5054 server.go:1263] "Started kubelet"
Nov 02 17:39:56.564052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.563572    5054 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 17:39:56.564052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.563695    5054 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 17:39:56.564052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.563759    5054 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 17:39:56.564040 ip-10-0-132-5 systemd[1]: Started Kubernetes Kubelet.
Nov 02 17:39:56.564401 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.564157    5054 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 17:39:56.565400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.565381    5054 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 17:39:56.571549 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571282    5054 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 17:39:56.571648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571549    5054 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 17:39:56.571725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571689    5054 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 17:34:16 +0000 UTC" deadline="2028-05-31 16:19:04.035422651 +0000 UTC"
Nov 02 17:39:56.571725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571721    5054 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13822h39m7.463704327s"
Nov 02 17:39:56.571919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571764    5054 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 17:39:56.571919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571772    5054 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 17:39:56.571919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.571902    5054 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 17:39:56.572069 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.572027    5054 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-5.us-east-2.compute.internal\" not found"
Nov 02 17:39:56.572621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.572598    5054 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:56.574332 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.574215    5054 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:56.575156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575137    5054 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:56.575310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575266    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eacac3ba-6173-429b-a590-8e6393a738da" volumeName="kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6" seLinuxMountContext=""
Nov 02 17:39:56.575365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575314    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff0f3fcf-4203-4f41-b835-07eb54829bc3" volumeName="kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f" seLinuxMountContext=""
Nov 02 17:39:56.575365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575328    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fad1209-655a-4176-b80f-a36b18d32310" volumeName="kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle" seLinuxMountContext=""
Nov 02 17:39:56.575365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575340    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1096cec7-3002-445f-aa4a-0fe1a6f1fab8" volumeName="kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78" seLinuxMountContext=""
Nov 02 17:39:56.575365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575352    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20498905-a7ee-4693-af66-069c9fe67f64" volumeName="kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume" seLinuxMountContext=""
Nov 02 17:39:56.575365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575365    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ba0d151-94e7-450f-8b5d-3873a538a8a9" volumeName="kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575378    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d2d7655-ead5-46f0-9837-9cb4a2671721" volumeName="kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575390    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60a4d219-d7c3-4dce-b7fd-fa05c2fb7943" volumeName="kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575405    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" volumeName="kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575420    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" volumeName="kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575433    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63887114-eb90-460e-a7ed-a4bf04e4fea6" volumeName="kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575445    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" volumeName="kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575457    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229" volumeName="kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575469    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c660205d-a64f-4693-9175-dc3d82e75ecc" volumeName="kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575499    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d62c4231-ec62-436e-8eef-96bda48364c7" volumeName="kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575510    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3da2857-f9bf-40a6-8b02-46423bcd5516" volumeName="kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575523    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1520f556-1207-43c4-afad-fe19f9bbf7c0" volumeName="kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575536    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575548    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af88b340-3cce-4031-8251-e39cedaf0916" volumeName="kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575560    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1096cec7-3002-445f-aa4a-0fe1a6f1fab8" volumeName="kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575572    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575583    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85ca2f8a-a233-42ed-87be-78984e39ee6f" volumeName="kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575600    5054 factory.go:55] Registering systemd factory
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575617    5054 factory.go:223] Registration of the systemd container factory successfully
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575598    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cc3e86b-8f7d-44da-8227-1240cf3b4167" volumeName="kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575673    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" volumeName="kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575694    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3eabc500-70b1-45d8-82c1-c8fc8fcd6d55" volumeName="kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key" seLinuxMountContext=""
Nov 02 17:39:56.575697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575708    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="203127f1-2169-422e-a508-793327fd6553" volumeName="kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575721    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20498905-a7ee-4693-af66-069c9fe67f64" volumeName="kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575735    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575757    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575776    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85ca2f8a-a233-42ed-87be-78984e39ee6f" volumeName="kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575788    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cdd8bd1-8fdf-4af1-8779-3a9934ac125f" volumeName="kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575799    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63887114-eb90-460e-a7ed-a4bf04e4fea6" volumeName="kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575810    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575822    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575833    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fad1209-655a-4176-b80f-a36b18d32310" volumeName="kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575861    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf4b7b16-845b-45bd-b139-62a876719b5c" volumeName="kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575873    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d111045-5f11-4638-9002-179905dd2006" volumeName="kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575884    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3eabc500-70b1-45d8-82c1-c8fc8fcd6d55" volumeName="kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575896    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575908    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60a4d219-d7c3-4dce-b7fd-fa05c2fb7943" volumeName="kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575919    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cc3e86b-8f7d-44da-8227-1240cf3b4167" volumeName="kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575931    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b14a0a20-b96d-426d-821a-4b5befbaa1d5" volumeName="kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575941    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575952    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" volumeName="kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575963    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fad1209-655a-4176-b80f-a36b18d32310" volumeName="kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575977    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cc3e86b-8f7d-44da-8227-1240cf3b4167" volumeName="kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.575988    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ba0d151-94e7-450f-8b5d-3873a538a8a9" volumeName="kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576001    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576011    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d111045-5f11-4638-9002-179905dd2006" volumeName="kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576023    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="203127f1-2169-422e-a508-793327fd6553" volumeName="kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576035    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576049    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576060    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d125ccb7-dd74-43c4-8bdf-970121de6423" volumeName="kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576073    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1520f556-1207-43c4-afad-fe19f9bbf7c0" volumeName="kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576085    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576097    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576117    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576128    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576139    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2e9f10a-d472-47de-bb6d-fe29d2285945" volumeName="kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576152    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2149ddc6-1523-41b7-8f17-2dd5f85a7825" volumeName="kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576173    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576185    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" volumeName="kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576196    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" volumeName="kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576208    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d111045-5f11-4638-9002-179905dd2006" volumeName="kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576219    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3eabc500-70b1-45d8-82c1-c8fc8fcd6d55" volumeName="kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576231    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576242    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229" volumeName="kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576254    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fad1209-655a-4176-b80f-a36b18d32310" volumeName="kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576264    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="563fcb27-3a4d-4348-a663-5df435315279" volumeName="kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576276    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2149ddc6-1523-41b7-8f17-2dd5f85a7825" volumeName="kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576287    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85ca2f8a-a233-42ed-87be-78984e39ee6f" volumeName="kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576300    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b14a0a20-b96d-426d-821a-4b5befbaa1d5" volumeName="kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576311    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b14a0a20-b96d-426d-821a-4b5befbaa1d5" volumeName="kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576322    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc5bbef7-9279-44d0-b1fb-0dd242c10b88" volumeName="kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576332    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2e9f10a-d472-47de-bb6d-fe29d2285945" volumeName="kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576343    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1520f556-1207-43c4-afad-fe19f9bbf7c0" volumeName="kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576357    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="442db46e-32cb-4277-a51c-fae4c064c817" volumeName="kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576371    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60a4d219-d7c3-4dce-b7fd-fa05c2fb7943" volumeName="kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576382    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" volumeName="kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576393    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" volumeName="kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576405    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf4b7b16-845b-45bd-b139-62a876719b5c" volumeName="kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576417    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" volumeName="kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576428    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63887114-eb90-460e-a7ed-a4bf04e4fea6" volumeName="kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576440    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2978e7a-385f-4edb-8bac-e691bb7e8c69" volumeName="kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576451    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d111045-5f11-4638-9002-179905dd2006" volumeName="kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576462    5054 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" volumeName="kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt" seLinuxMountContext=""
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576473    5054 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 17:39:56.576527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.576480    5054 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.578873    5054 factory.go:153] Registering CRI-O factory
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.578893    5054 factory.go:223] Registration of the crio container factory successfully
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.578952    5054 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.578976    5054 factory.go:103] Registering Raw factory
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.578990    5054 manager.go:1199] Started watching for new ooms in manager
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.579285    5054 manager.go:319] Starting recovery of all containers
Nov 02 17:39:56.580875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.580516    5054 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 02 17:39:56.597943 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.597916    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:56.599714 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.599693    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:56.603807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.603784    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:56.605152 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.605009    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:56.606393 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.606359    5054 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 17:39:56.608460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.608438    5054 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 17:39:56.608460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.608461    5054 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 17:39:56.608599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.608482    5054 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 17:39:56.608599 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.608518    5054 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 02 17:39:56.613440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.613379    5054 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 17:39:56.626132 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.626113    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:56.626231 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.626139    5054 generic.go:356] "Generic (PLEG): container finished" podID="0d111045-5f11-4638-9002-179905dd2006" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87" exitCode=255
Nov 02 17:39:56.639934 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639903    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="0546a0d447983099145f61eaeda0635280195fe7433b5a08efb2ecfd14750ea5" exitCode=0
Nov 02 17:39:56.639934 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639932    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="8eea01770c9b6f27f3739e8ad9b2caae445908d945733fd2353852cb9f14b1c5" exitCode=0
Nov 02 17:39:56.640065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639941    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="61b1cb38957cf7c73ebe50bd6f72283720249f0f8662fb9fef2d5b3f3214f1a7" exitCode=0
Nov 02 17:39:56.640065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639950    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="ec6e2211b6b5762604e04b83641cc54106286f276e09fc4870d876675b5962fc" exitCode=0
Nov 02 17:39:56.640065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639957    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="722cc1a2007b95e851bae0998013c7b0fcd419061720b5b320330ec545aa78a5" exitCode=0
Nov 02 17:39:56.640065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.639964    5054 generic.go:356] "Generic (PLEG): container finished" podID="6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4" containerID="56438841a1d7bf95954ac8daafd5133933ff0c7a505a239a0d8151e5e6a09fa6" exitCode=0
Nov 02 17:39:56.645510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.645488    5054 generic.go:356] "Generic (PLEG): container finished" podID="7d3c8112ada91bb137b5c031fc287485" containerID="4731e519a5ab3b5d84c5bc237d3a35664b2b26235ab840e5935e3bcefb6e1bea" exitCode=0
Nov 02 17:39:56.659129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.659111    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:39:56.659483 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.659459    5054 generic.go:356] "Generic (PLEG): container finished" podID="b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d" containerID="33829db443abad3cf8702f9ae4566bf3fee59e5c127e6575f6f75a7465dee4db" exitCode=1
Nov 02 17:39:56.677562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.677545    5054 manager.go:324] Recovery completed
Nov 02 17:39:56.700691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700663    5054 cpu_manager.go:226] "Starting" policy="none"
Nov 02 17:39:56.700691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700682    5054 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 17:39:56.700810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700702    5054 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 17:39:56.700859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700825    5054 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 02 17:39:56.700891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700852    5054 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 02 17:39:56.700936 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700918    5054 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 02 17:39:56.700936 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700926    5054 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 02 17:39:56.700936 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700934    5054 policy_none.go:50] "Start"
Nov 02 17:39:56.701025 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700944    5054 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 17:39:56.701025 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.700954    5054 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 17:39:56.701090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.701080    5054 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 02 17:39:56.701120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.701090    5054 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 02 17:39:56.701120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.701096    5054 policy_none.go:44] "Start"
Nov 02 17:39:56.705641 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.705614    5054 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 17:39:56.708204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.708191    5054 manager.go:341] "Starting Device Plugin manager"
Nov 02 17:39:56.708574 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.708556    5054 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 02 17:39:56.708722 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.708216    5054 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 17:39:56.708753 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.708726    5054 server.go:87] "Starting device plugin registration server"
Nov 02 17:39:56.708988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.708978    5054 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 17:39:56.709022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.708988    5054 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 17:39:56.709533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.709103    5054 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 17:39:56.709533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.709198    5054 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 17:39:56.709533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.709235    5054 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 17:39:56.709533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.709241    5054 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 17:39:56.709533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.709290    5054 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T17:39:56.709224948Z","UUID":"62e924ff-ec90-4905-b458-67a41f25079d","Handler":null,"Name":"","Endpoint":""}
Nov 02 17:39:56.711059 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.711038    5054 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 17:39:56.711148 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.711073    5054 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 17:39:56.711268 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.711256    5054 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 17:39:56.809461 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.809431    5054 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 17:39:56.810791 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.810774    5054 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 17:39:56.810869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.810805    5054 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 17:39:56.810869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.810819    5054 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-5.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 17:39:56.810942 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.810894    5054 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.827978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.827956    5054 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.828069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.828028    5054 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.909058 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.908964    5054 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"]
Nov 02 17:39:56.909626 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909592    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerStarted","Data":"9daf5c9c9305d2e11434ee37e4a78a4b32ce7607c2da8745563a3be4f074c7e4"}
Nov 02 17:39:56.909681 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909633    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerDied","Data":"4731e519a5ab3b5d84c5bc237d3a35664b2b26235ab840e5935e3bcefb6e1bea"}
Nov 02 17:39:56.909681 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909655    5054 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.909754 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909721    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"7d3c8112ada91bb137b5c031fc287485","Type":"ContainerStarted","Data":"a4571561b5afb7ff57e689303d44b416610fc27db6c0f83e61e897c31fd9b04c"}
Nov 02 17:39:56.909784 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909773    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"f23d73ef12b6a83fae531e9ed10d8052","Type":"ContainerStarted","Data":"0edfe25ae9d3beea2ecbd260c40bc8784aebe35b6da42a2a0a0ca5b2effe9599"}
Nov 02 17:39:56.909812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909786    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal" event={"ID":"f23d73ef12b6a83fae531e9ed10d8052","Type":"ContainerStarted","Data":"34ee9799bf47293d9e62d1a41bc2b45248461a2c6ff4744dc1783acf508423f7"}
Nov 02 17:39:56.909924 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.909910    5054 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.929537 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.929519    5054 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:56.929641 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.929558    5054 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.929641 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.929523    5054 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:56.929641 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:56.929627    5054 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.981921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.981894    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.982024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.981920    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:56.982024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:56.981939    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082464 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082435    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082464 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082465    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082492    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082534    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082541    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f23d73ef12b6a83fae531e9ed10d8052-config\") pod \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"f23d73ef12b6a83fae531e9ed10d8052\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.082598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.082541    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d3c8112ada91bb137b5c031fc287485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" (UID: \"7d3c8112ada91bb137b5c031fc287485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.555209 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.555175    5054 apiserver.go:52] "Watching apiserver"
Nov 02 17:39:57.569925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.569895    5054 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 17:39:57.570879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.570831    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-vkzt5","kube-system/kas-connection-checker-685895c7c9-v9dk7","openshift-console-operator/console-operator-7cd56b8dbc-lgcz9","kube-system/kas-connection-checker-685895c7c9-d8jlp","kube-system/kas-connection-checker-685895c7c9-t5xrk","openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt","openshift-dns/dns-default-xlnh4","kube-system/global-pull-secret-syncer-fmrts","openshift-ingress-canary/ingress-canary-t682l","openshift-multus/network-metrics-daemon-rn4m9","openshift-network-operator/iptables-alerter-8cp4n","kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal","openshift-network-console/networking-console-plugin-86c478bb88-rhvj2","openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs","openshift-insights/periodic-gathering-94b2v-6qnfm","openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal","openshift-multus/multus-fhdv5","openshift-image-registry/image-registry-f6589b9bd-vlx6x","openshift-ovn-kubernetes/ovnkube-node-mpwgj","openshift-dns/node-resolver-b5tc5","openshift-service-ca/service-ca-5fffc97bdf-fx2ps","openshift-insights/insights-operator-7c4986d449-j6zs5","openshift-multus/multus-additional-cni-plugins-dk9mr","openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8","openshift-network-diagnostics/network-check-target-9b9vg","openshift-insights/insights-runtime-extractor-jb2qt","openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg","openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn","openshift-image-registry/node-ca-fqvxr","openshift-ingress/router-default-86cdd8bc45-6t746","kube-system/konnectivity-agent-9h65q"]
Nov 02 17:39:57.574188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.574148    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.575403 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.575377    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.575504 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.575466    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.575751 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.575730    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.575879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.575825    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.577542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.577525    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.577918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.577898    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:57.578016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.578001    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.578067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.578019    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.578099 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.578083    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 02 17:39:57.580064 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.580047    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.583362 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.583346    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.583862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.583802    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.585347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.585318    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bzr\" (UniqueName: \"kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr\") pod \"kas-connection-checker-685895c7c9-d8jlp\" (UID: \"dc5bbef7-9279-44d0-b1fb-0dd242c10b88\") " pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:57.585347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.585364    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpw8p\" (UniqueName: \"kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p\") pod \"kas-connection-checker-685895c7c9-v9dk7\" (UID: \"d125ccb7-dd74-43c4-8bdf-970121de6423\") " pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:57.585596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.585391    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.586250 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.586225    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 02 17:39:57.586332 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.586252    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.586430 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.586410    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 02 17:39:57.586820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.586798    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 02 17:39:57.587420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.587398    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 02 17:39:57.587523 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.587494    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 02 17:39:57.587664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.587645    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.588034 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.588012    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 02 17:39:57.588294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.588270    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.588553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.588333    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.588659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.588640    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 02 17:39:57.588776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.588753    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 02 17:39:57.589166 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.589144    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.589656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.589627    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.589909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.589888    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 02 17:39:57.590079 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590058    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 02 17:39:57.590525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590503    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.590615 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590592    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 02 17:39:57.590729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590517    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.590798 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590759    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.590798 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590774    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 02 17:39:57.590909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.590860    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.591204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591183    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 02 17:39:57.591282 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591190    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.591477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591453    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.591543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591460    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 02 17:39:57.591543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591527    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.591627 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591573    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 02 17:39:57.591721 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591703    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.591767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.591750    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.593612 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.593553    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 17:39:57.594090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594070    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 02 17:39:57.594177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594123    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.594177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594143    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zvsl\""
Nov 02 17:39:57.594374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594330    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.594433 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594420    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.594505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594485    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 17:39:57.594567 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594522    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 02 17:39:57.594567 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594542    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zpgl9\""
Nov 02 17:39:57.594665 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594571    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 02 17:39:57.594665 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594636    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594668    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-th4zf\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594671    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594702    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rjwn5\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594711    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4rgm\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594732    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594572    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-6x7d8\""
Nov 02 17:39:57.594818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594638    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594821    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594826    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-mkftb\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594812    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594879    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.594917    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595014    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-scp8s\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595067    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 02 17:39:57.595175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595089    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595202    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595220    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595228    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595237    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b2827\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595252    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595316    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zqcnj\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595328    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595319    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595384    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595391    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595478    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 17:39:57.595572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595500    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jk79z\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595594    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4dl6t\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595649    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595950    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-kkqh6\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595951    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595973    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595983    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.595968    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzjcr\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.596014    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.596021    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.596041    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 02 17:39:57.596163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.596077    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.597505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.597490    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 17:39:57.599071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599048    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 17:39:57.599174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599052    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.599174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599127    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 02 17:39:57.599309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599293    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 17:39:57.599364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599312    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.599364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599323    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7mg2x\""
Nov 02 17:39:57.599497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599377    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 17:39:57.599497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599408    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs2ss\""
Nov 02 17:39:57.599497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599443    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 17:39:57.599497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599486    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 17:39:57.599497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599488    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4kkz9\""
Nov 02 17:39:57.599780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599503    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gjv4t\""
Nov 02 17:39:57.599780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599535    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7flsb\""
Nov 02 17:39:57.599780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599603    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 02 17:39:57.599898 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599876    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 17:39:57.599952 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599936    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpw8p\" (UniqueName: \"kubernetes.io/projected/d125ccb7-dd74-43c4-8bdf-970121de6423-kube-api-access-vpw8p\") pod \"kas-connection-checker-685895c7c9-v9dk7\" (UID: \"d125ccb7-dd74-43c4-8bdf-970121de6423\") " pod="kube-system/kas-connection-checker-685895c7c9-v9dk7"
Nov 02 17:39:57.599986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.599965    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bzr\" (UniqueName: \"kubernetes.io/projected/dc5bbef7-9279-44d0-b1fb-0dd242c10b88-kube-api-access-t2bzr\") pod \"kas-connection-checker-685895c7c9-d8jlp\" (UID: \"dc5bbef7-9279-44d0-b1fb-0dd242c10b88\") " pod="kube-system/kas-connection-checker-685895c7c9-d8jlp"
Nov 02 17:39:57.600475 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600461    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fnjk8\""
Nov 02 17:39:57.600510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600492    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.600545 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600526    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 02 17:39:57.600545 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600533    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.600659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600552    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 02 17:39:57.600659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600577    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 02 17:39:57.600659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.600641    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v8fl6\""
Nov 02 17:39:57.673023 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.673001    5054 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.673167 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.673155    5054 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.674218 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.674201    5054 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 17:39:57.685279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685258    5054 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:57.685376 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.685300    5054 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.685733 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685711    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.685802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685746    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.685891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685808    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.685891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685816    5054 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 17:39:57.685891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685871    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.685891 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.685878    5054 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-5.us-east-2.compute.internal"
Nov 02 17:39:57.686065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.685997    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.686065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686022    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.686065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686042    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.686065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686040    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.686230 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686162    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:57.686230 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686209    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-tuned\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.686334 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686257    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.686398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686375    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.686821 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686798    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdhd\" (UniqueName: \"kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.686944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686815    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2e9f10a-d472-47de-bb6d-fe29d2285945-konnectivity-ca\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:57.686944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.686886    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.687119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687080    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8vt\" (UniqueName: \"kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.687210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687188    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kclwt\" (UniqueName: \"kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt\") pod \"kas-connection-checker-685895c7c9-t5xrk\" (UID: \"e2978e7a-385f-4edb-8bac-e691bb7e8c69\") " pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:57.687257 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687115    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.687257 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687233    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.687344 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687263    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687344 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687293    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687344 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687324    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.687525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687357    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.687525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687459    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687498    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.687525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687507    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14a0a20-b96d-426d-821a-4b5befbaa1d5-tmp\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687768    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-default-certificate\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.687870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687822    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687947 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687920    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.687947 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.687917    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-daemon-config\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.688042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688009    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.688115 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688070    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.688166 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688142    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.688216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688186    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.688265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688221    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.688311 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688277    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjzj\" (UniqueName: \"kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.688381 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688334    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.688425 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688383    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.688470 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688442    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.688519 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688474    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:57.688519 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688499    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.688622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688529    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.688622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688584    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.688719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688638    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.688719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688642    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba0d151-94e7-450f-8b5d-3873a538a8a9-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.688719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688667    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.688914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688733    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.688983    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-env-overrides\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689153    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1520f556-1207-43c4-afad-fe19f9bbf7c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689205    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689314    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689351    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689572    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/203127f1-2169-422e-a508-793327fd6553-cert\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689608    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689776    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689824    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689887    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689935    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.689943    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-key\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690159    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690314    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690351    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690401    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.690440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690428    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690466    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690495    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7hv\" (UniqueName: \"kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690524    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fg84\" (UniqueName: \"kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690553    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwkt\" (UniqueName: \"kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690584    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q452d\" (UniqueName: \"kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690610    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690639    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690667    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sjv\" (UniqueName: \"kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690682    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-service-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690697    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690729    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690763    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690794    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690826    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690872    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690897    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690927    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26cd\" (UniqueName: \"kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690960    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.690998    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691113    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691196    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691219    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-config\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691279    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2f8f\" (UniqueName: \"kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.691392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691377    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2149ddc6-1523-41b7-8f17-2dd5f85a7825-iptables-alerter-script\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691901    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691938    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.691982    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/442db46e-32cb-4277-a51c-fae4c064c817-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692197    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692246    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692274    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692352    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692385    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692419    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692419    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d111045-5f11-4638-9002-179905dd2006-serving-cert\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692462    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692490    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62c4231-ec62-436e-8eef-96bda48364c7-original-pull-secret\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692534    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.692620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692587    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692755    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692770    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-config\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692773    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692792    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ca2f8a-a233-42ed-87be-78984e39ee6f-serving-cert\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692794    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692874    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz78\" (UniqueName: \"kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.692979    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693201    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693246    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693284    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693355    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693394    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.693434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693411    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kclwt\" (UniqueName: \"kubernetes.io/projected/e2978e7a-385f-4edb-8bac-e691bb7e8c69-kube-api-access-kclwt\") pod \"kas-connection-checker-685895c7c9-t5xrk\" (UID: \"e2978e7a-385f-4edb-8bac-e691bb7e8c69\") " pod="kube-system/kas-connection-checker-685895c7c9-t5xrk"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693475    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693508    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8vt\" (UniqueName: \"kubernetes.io/projected/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-kube-api-access-cq8vt\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693514    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693564    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693567    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693594    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdhd\" (UniqueName: \"kubernetes.io/projected/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-kube-api-access-jbdhd\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693600    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mln9g\" (UniqueName: \"kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g\") pod \"migrator-66df5d496b-csrzn\" (UID: \"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693654    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldb6\" (UniqueName: \"kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693707    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eabc500-70b1-45d8-82c1-c8fc8fcd6d55-signing-cabundle\") pod \"service-ca-5fffc97bdf-fx2ps\" (UID: \"3eabc500-70b1-45d8-82c1-c8fc8fcd6d55\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fx2ps"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693775    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693828    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693887    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693922    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxm5d\" (UniqueName: \"kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693950    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.693989    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694032    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694109    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694145    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694171    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694202    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694260    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qm4\" (UniqueName: \"kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694299    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694305    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-tmp-dir\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694315    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-config-volume\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.694290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694329    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qml5k\" (UniqueName: \"kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694379    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694419    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694460    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694487    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ca2f8a-a233-42ed-87be-78984e39ee6f-config\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694498    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694523    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694587    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694648    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694698    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694714    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-stats-auth\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694731    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cni-binary-copy\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694757    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694792    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694824    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694872    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694925    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694942    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-tmp\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694957    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgzf\" (UniqueName: \"kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf\") pod \"volume-data-source-validator-58c9f5f46d-hlgbg\" (UID: \"c660205d-a64f-4693-9175-dc3d82e75ecc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.694984    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695028    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovnkube-script-lib\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695031    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/442db46e-32cb-4277-a51c-fae4c064c817-snapshots\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695077    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695089    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2e9f10a-d472-47de-bb6d-fe29d2285945-agent-certs\") pod \"konnectivity-agent-9h65q\" (UID: \"e2e9f10a-d472-47de-bb6d-fe29d2285945\") " pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695163    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-tmp-dir\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695169    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20498905-a7ee-4693-af66-069c9fe67f64-data-volume\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695185    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjzj\" (UniqueName: \"kubernetes.io/projected/20498905-a7ee-4693-af66-069c9fe67f64-kube-api-access-5vjzj\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695276    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhszd\" (UniqueName: \"kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd\") pod \"network-check-source-6f78d59f99-p7tvx\" (UID: \"5d2d7655-ead5-46f0-9837-9cb4a2671721\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695297    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695347    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695378    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442db46e-32cb-4277-a51c-fae4c064c817-serving-cert\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695386    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695417    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695439    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljk8\" (UniqueName: \"kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.695495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695459    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695527    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695554    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695570    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695593    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4fn\" (UniqueName: \"kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695614    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695632    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695650    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695831    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5t9\" (UniqueName: \"kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695896    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwssv\" (UniqueName: \"kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv\") pod \"migrator-66df5d496b-qpv2w\" (UID: \"e3da2857-f9bf-40a6-8b02-46423bcd5516\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.695930    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696083    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-ovn-node-metrics-cert\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696110    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696150    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696176    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696216    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696259    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696300    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696317    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf4b7b16-845b-45bd-b139-62a876719b5c-serviceca\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696336    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696459    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/563fcb27-3a4d-4348-a663-5df435315279-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696476    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696540    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d111045-5f11-4638-9002-179905dd2006-trusted-ca\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696551    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696554    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696603    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696662    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8nd\" (UniqueName: \"kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696698    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696734    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696764    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps24\" (UniqueName: \"kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696787    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.696819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696807    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"periodic-gathering-94b2v-6qnfm\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") " pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:39:57.697658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.696904    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1520f556-1207-43c4-afad-fe19f9bbf7c0-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.697658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.697020    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.698909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.698883    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fg84\" (UniqueName: \"kubernetes.io/projected/cf4b7b16-845b-45bd-b139-62a876719b5c-kube-api-access-4fg84\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.698975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.698886    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7hv\" (UniqueName: \"kubernetes.io/projected/af88b340-3cce-4031-8251-e39cedaf0916-kube-api-access-bd7hv\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.699071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.699050    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26cd\" (UniqueName: \"kubernetes.io/projected/b14a0a20-b96d-426d-821a-4b5befbaa1d5-kube-api-access-x26cd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.699183 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.699162    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sjv\" (UniqueName: \"kubernetes.io/projected/1520f556-1207-43c4-afad-fe19f9bbf7c0-kube-api-access-78sjv\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-scfj8\" (UID: \"1520f556-1207-43c4-afad-fe19f9bbf7c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8"
Nov 02 17:39:57.699220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.699179    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.699342 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.699327    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q452d\" (UniqueName: \"kubernetes.io/projected/442db46e-32cb-4277-a51c-fae4c064c817-kube-api-access-q452d\") pod \"insights-operator-7c4986d449-j6zs5\" (UID: \"442db46e-32cb-4277-a51c-fae4c064c817\") " pod="openshift-insights/insights-operator-7c4986d449-j6zs5"
Nov 02 17:39:57.702951 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.702931    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.703035 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.703018    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2f8f\" (UniqueName: \"kubernetes.io/projected/ff0f3fcf-4203-4f41-b835-07eb54829bc3-kube-api-access-m2f8f\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.703202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.703177    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwkt\" (UniqueName: \"kubernetes.io/projected/0d111045-5f11-4638-9002-179905dd2006-kube-api-access-cjwkt\") pod \"console-operator-7cd56b8dbc-lgcz9\" (UID: \"0d111045-5f11-4638-9002-179905dd2006\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:39:57.703315 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.703298    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz78\" (UniqueName: \"kubernetes.io/projected/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-kube-api-access-xpz78\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.708591 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.708573    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldb6\" (UniqueName: \"kubernetes.io/projected/3ba0d151-94e7-450f-8b5d-3873a538a8a9-kube-api-access-5ldb6\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.708690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.708622    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgzf\" (UniqueName: \"kubernetes.io/projected/c660205d-a64f-4693-9175-dc3d82e75ecc-kube-api-access-6pgzf\") pod \"volume-data-source-validator-58c9f5f46d-hlgbg\" (UID: \"c660205d-a64f-4693-9175-dc3d82e75ecc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hlgbg"
Nov 02 17:39:57.708690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.708666    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qm4\" (UniqueName: \"kubernetes.io/projected/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-kube-api-access-59qm4\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.709282 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.709253    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxm5d\" (UniqueName: \"kubernetes.io/projected/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-kube-api-access-vxm5d\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.709957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.709940    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mln9g\" (UniqueName: \"kubernetes.io/projected/8cdd8bd1-8fdf-4af1-8779-3a9934ac125f-kube-api-access-mln9g\") pod \"migrator-66df5d496b-csrzn\" (UID: \"8cdd8bd1-8fdf-4af1-8779-3a9934ac125f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-csrzn"
Nov 02 17:39:57.710302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.710287    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qml5k\" (UniqueName: \"kubernetes.io/projected/203127f1-2169-422e-a508-793327fd6553-kube-api-access-qml5k\") pod \"ingress-canary-t682l\" (UID: \"203127f1-2169-422e-a508-793327fd6553\") " pod="openshift-ingress-canary/ingress-canary-t682l"
Nov 02 17:39:57.712319 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.712299    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.712398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.712343    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhszd\" (UniqueName: \"kubernetes.io/projected/5d2d7655-ead5-46f0-9837-9cb4a2671721-kube-api-access-zhszd\") pod \"network-check-source-6f78d59f99-p7tvx\" (UID: \"5d2d7655-ead5-46f0-9837-9cb4a2671721\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-p7tvx"
Nov 02 17:39:57.714232 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.714216    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4fn\" (UniqueName: \"kubernetes.io/projected/2149ddc6-1523-41b7-8f17-2dd5f85a7825-kube-api-access-kt4fn\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.714912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.714582    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8nd\" (UniqueName: \"kubernetes.io/projected/63887114-eb90-460e-a7ed-a4bf04e4fea6-kube-api-access-kx8nd\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.714912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.714869    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.715042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.714913    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljk8\" (UniqueName: \"kubernetes.io/projected/9cc3e86b-8f7d-44da-8227-1240cf3b4167-kube-api-access-8ljk8\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.715042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.714980    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5t9\" (UniqueName: \"kubernetes.io/projected/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-kube-api-access-rr5t9\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.715042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.715013    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwssv\" (UniqueName: \"kubernetes.io/projected/e3da2857-f9bf-40a6-8b02-46423bcd5516-kube-api-access-xwssv\") pod \"migrator-66df5d496b-qpv2w\" (UID: \"e3da2857-f9bf-40a6-8b02-46423bcd5516\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qpv2w"
Nov 02 17:39:57.715223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.715198    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cq6\" (UniqueName: \"kubernetes.io/projected/eacac3ba-6173-429b-a590-8e6393a738da-kube-api-access-26cq6\") pod \"network-check-target-9b9vg\" (UID: \"eacac3ba-6173-429b-a590-8e6393a738da\") " pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:39:57.715828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.715811    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps24\" (UniqueName: \"kubernetes.io/projected/85ca2f8a-a233-42ed-87be-78984e39ee6f-kube-api-access-pps24\") pod \"service-ca-operator-544d749c8c-hspzs\" (UID: \"85ca2f8a-a233-42ed-87be-78984e39ee6f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs"
Nov 02 17:39:57.798132 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798099    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.798269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798138    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.798269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798161    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798211    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-etc-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.798269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798249    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.798269 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.798256    5054 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798274    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798291    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798305    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798309    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-conf\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.798321    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:58.29830309 +0000 UTC m=+1.807065148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798336    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2149ddc6-1523-41b7-8f17-2dd5f85a7825-host-slash\") pod \"iptables-alerter-8cp4n\" (UID: \"2149ddc6-1523-41b7-8f17-2dd5f85a7825\") " pod="openshift-network-operator/iptables-alerter-8cp4n"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798356    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798383    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798402    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-netns\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798357    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-var-lib-kubelet\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798414    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798386    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-system-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798428    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-systemd-units\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798450    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798456    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysconfig\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798468    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-systemd\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798475    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798500    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798525    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.798517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798549    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798549    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-dbus\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798592    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-host\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798614    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798642    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798657    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-conf-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798663    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798697    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798700    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-var-lib-openvswitch\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798706    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798733    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798756    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-socket-dir-parent\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798761    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798786    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-kubelet\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798785    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798827    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798847    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-slash\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798875    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798893    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798896    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-socket-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798908    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-cnibin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798912    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798939    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-ovn\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798941    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-k8s-cni-cncf-io\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798954    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-device-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798956    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.798990    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799016    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799044    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799044    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799080    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799113    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf4b7b16-845b-45bd-b139-62a876719b5c-host\") pod \"node-ca-fqvxr\" (UID: \"cf4b7b16-845b-45bd-b139-62a876719b5c\") " pod="openshift-image-registry/node-ca-fqvxr"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799115    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799142    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799152    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20498905-a7ee-4693-af66-069c9fe67f64-crio-socket\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799158    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799185    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799193    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799213    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799218    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63887114-eb90-460e-a7ed-a4bf04e4fea6-service-ca-bundle\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799239    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799264    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799288    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799289    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-sys\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799287    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-node-log\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799312    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799313    5054 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799340    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-etc-kubernetes\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799350    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799375    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799384    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-hostroot\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799398    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799421    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.799399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799429    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-kubernetes\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799448    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799474    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799478    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-run\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799498    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799516    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-kubelet\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799539    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-bin\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799551    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799499    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-registration-dir\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799568    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-multus-cni-dir\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799592    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799616    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799636    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799646    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-lib-modules\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799659    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799678    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-sysctl-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799688    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799695    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799714    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799722    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229-hosts-file\") pod \"node-resolver-b5tc5\" (UID: \"7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229\") " pod="openshift-dns/node-resolver-b5tc5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799737    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.799767    5054 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799791    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.799824    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:58.299808281 +0000 UTC m=+1.808570341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799766    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-bin\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.799877    5054 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799888    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:57.799935    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert podName:563fcb27-3a4d-4348-a663-5df435315279 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:58.299919071 +0000 UTC m=+1.808681130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rhvj2" (UID: "563fcb27-3a4d-4348-a663-5df435315279") : secret "networking-console-plugin-cert" not found
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799957    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-var-lib-cni-multus\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.799974    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-run-netns\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800000    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-run-systemd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800032    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800059    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800095    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800122    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800128    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-log-socket\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800097    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cc3e86b-8f7d-44da-8227-1240cf3b4167-host-run-multus-certs\") pod \"multus-fhdv5\" (UID: \"9cc3e86b-8f7d-44da-8227-1240cf3b4167\") " pod="openshift-multus/multus-fhdv5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800168    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4-cnibin\") pod \"multus-additional-cni-plugins-dk9mr\" (UID: \"6d9cc0e7-d2b8-4c04-804d-bf25eb004bc4\") " pod="openshift-multus/multus-additional-cni-plugins-dk9mr"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800172    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800205    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800207    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b14a0a20-b96d-426d-821a-4b5befbaa1d5-etc-modprobe-d\") pod \"tuned-vkzt5\" (UID: \"b14a0a20-b96d-426d-821a-4b5befbaa1d5\") " pod="openshift-cluster-node-tuning-operator/tuned-vkzt5"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800270    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800299    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800327    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800352    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800435    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af88b340-3cce-4031-8251-e39cedaf0916-sys-fs\") pod \"aws-ebs-csi-driver-node-m5wzt\" (UID: \"af88b340-3cce-4031-8251-e39cedaf0916\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5wzt"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800433    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62c4231-ec62-436e-8eef-96bda48364c7-kubelet-config\") pod \"global-pull-secret-syncer-fmrts\" (UID: \"d62c4231-ec62-436e-8eef-96bda48364c7\") " pod="kube-system/global-pull-secret-syncer-fmrts"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800472    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-cni-netd\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800487    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mpwgj\" (UID: \"b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d\") " pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:39:57.801449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.800760    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20498905-a7ee-4693-af66-069c9fe67f64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.802280    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1096cec7-3002-445f-aa4a-0fe1a6f1fab8-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-h27kn\" (UID: \"1096cec7-3002-445f-aa4a-0fe1a6f1fab8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.802396    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff0f3fcf-4203-4f41-b835-07eb54829bc3-metrics-certs\") pod \"network-metrics-daemon-rn4m9\" (UID: \"ff0f3fcf-4203-4f41-b835-07eb54829bc3\") " pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.802425    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60a4d219-d7c3-4dce-b7fd-fa05c2fb7943-metrics-tls\") pod \"dns-default-xlnh4\" (UID: \"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943\") " pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.802703    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"image-registry-5fb5fdd4d9-nv2tc\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") " pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.802908    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba0d151-94e7-450f-8b5d-3873a538a8a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-lckhg\" (UID: \"3ba0d151-94e7-450f-8b5d-3873a538a8a9\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.803601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.803146    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"image-registry-f6589b9bd-vlx6x\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") " pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.874792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.874712    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"
Nov 02 17:39:57.875532 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.875513    5054 scope.go:122] "RemoveContainer" containerID="44e917c597daf22ec6983cea72432bd02d84001d8c817ef085542b330e6afa87"
Nov 02 17:39:57.875782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.875763    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"
Nov 02 17:39:57.877805 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.877788    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:39:57.883753 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.883734    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rn4m9"
Nov 02 17:39:57.884675 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.884661    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:39:57.885787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:57.885769    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:39:58.171609 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.171582    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn"]
Nov 02 17:39:58.210828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.210803    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg"]
Nov 02 17:39:58.214144 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.214106    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba0d151_94e7_450f_8b5d_3873a538a8a9.slice/crio-1ca1ef1fc1c93dd3977903b2f3624e6c343ccc6f2734558677e7664b0236a1d8 WatchSource:0}: Error finding container 1ca1ef1fc1c93dd3977903b2f3624e6c343ccc6f2734558677e7664b0236a1d8: Status 404 returned error can't find the container with id 1ca1ef1fc1c93dd3977903b2f3624e6c343ccc6f2734558677e7664b0236a1d8
Nov 02 17:39:58.216162 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.216147    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 17:39:58.260253 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.260218    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlnh4"]
Nov 02 17:39:58.263908 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.263883    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a4d219_d7c3_4dce_b7fd_fa05c2fb7943.slice/crio-bb954406182fadffa3d5d7f24b6801e1fa760ba95a04a8a3fd5b066c5094baa1 WatchSource:0}: Error finding container bb954406182fadffa3d5d7f24b6801e1fa760ba95a04a8a3fd5b066c5094baa1: Status 404 returned error can't find the container with id bb954406182fadffa3d5d7f24b6801e1fa760ba95a04a8a3fd5b066c5094baa1
Nov 02 17:39:58.267701 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.267680    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:39:58.272161 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.272139    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f86cf5_b7ad_4dbb_a6d7_4b2ccb808acf.slice/crio-9a94d3ebe93f509444d4650e69c90b8f7af67a0c0cfcc48411f8c37dc4d144ff WatchSource:0}: Error finding container 9a94d3ebe93f509444d4650e69c90b8f7af67a0c0cfcc48411f8c37dc4d144ff: Status 404 returned error can't find the container with id 9a94d3ebe93f509444d4650e69c90b8f7af67a0c0cfcc48411f8c37dc4d144ff
Nov 02 17:39:58.304992 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.304969    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:58.305089 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.305010    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:58.305089 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.305059    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:58.305210 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:58.305126    5054 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:58.305210 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:58.305196    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:59.305177678 +0000 UTC m=+2.813939739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:58.305318 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:58.305266    5054 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:58.305367 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:58.305323    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:39:59.305304547 +0000 UTC m=+2.814066606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:58.309871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.309823    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/563fcb27-3a4d-4348-a663-5df435315279-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rhvj2\" (UID: \"563fcb27-3a4d-4348-a663-5df435315279\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:58.318668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.318646    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rn4m9"]
Nov 02 17:39:58.322291 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.322266    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0f3fcf_4203_4f41_b835_07eb54829bc3.slice/crio-2779695e07f802a167b106b0d88e211f9c8ca95a194550c6521ae9b1933643e7 WatchSource:0}: Error finding container 2779695e07f802a167b106b0d88e211f9c8ca95a194550c6521ae9b1933643e7: Status 404 returned error can't find the container with id 2779695e07f802a167b106b0d88e211f9c8ca95a194550c6521ae9b1933643e7
Nov 02 17:39:58.347300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.347276    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:39:58.350441 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.350415    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5488c4_85f7_46b9_923b_a2f29bf8d1d8.slice/crio-b1f03c1c6dfe02fc35814d1f33fd2f4afcf1c962683b32a07fa8c630960c7675 WatchSource:0}: Error finding container b1f03c1c6dfe02fc35814d1f33fd2f4afcf1c962683b32a07fa8c630960c7675: Status 404 returned error can't find the container with id b1f03c1c6dfe02fc35814d1f33fd2f4afcf1c962683b32a07fa8c630960c7675
Nov 02 17:39:58.479190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.479156    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"
Nov 02 17:39:58.679604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.679572    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn" event={"ID":"1096cec7-3002-445f-aa4a-0fe1a6f1fab8","Type":"ContainerStarted","Data":"a2978d8e1d605fe0e2ecf912688e21f017898538a3615917dbeb1478f892b5b6"}
Nov 02 17:39:58.681676 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.681641    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" event={"ID":"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf","Type":"ContainerStarted","Data":"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"}
Nov 02 17:39:58.681814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.681697    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" event={"ID":"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf","Type":"ContainerStarted","Data":"9a94d3ebe93f509444d4650e69c90b8f7af67a0c0cfcc48411f8c37dc4d144ff"}
Nov 02 17:39:58.684042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.684021    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:39:58.684156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.684099    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9" event={"ID":"0d111045-5f11-4638-9002-179905dd2006","Type":"ContainerStarted","Data":"d66127d144106c39cce391f61ff2eaec26bf1b51c9e46dff708eb1fd00a6bdec"}
Nov 02 17:39:58.685579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.685558    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg" event={"ID":"3ba0d151-94e7-450f-8b5d-3873a538a8a9","Type":"ContainerStarted","Data":"1ca1ef1fc1c93dd3977903b2f3624e6c343ccc6f2734558677e7664b0236a1d8"}
Nov 02 17:39:58.688063 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.688028    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlnh4" event={"ID":"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943","Type":"ContainerStarted","Data":"bb954406182fadffa3d5d7f24b6801e1fa760ba95a04a8a3fd5b066c5094baa1"}
Nov 02 17:39:58.689252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.689219    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rn4m9" event={"ID":"ff0f3fcf-4203-4f41-b835-07eb54829bc3","Type":"ContainerStarted","Data":"2779695e07f802a167b106b0d88e211f9c8ca95a194550c6521ae9b1933643e7"}
Nov 02 17:39:58.690969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.690948    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" event={"ID":"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8","Type":"ContainerStarted","Data":"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"}
Nov 02 17:39:58.691071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.690984    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" event={"ID":"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8","Type":"ContainerStarted","Data":"b1f03c1c6dfe02fc35814d1f33fd2f4afcf1c962683b32a07fa8c630960c7675"}
Nov 02 17:39:58.757394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:58.757278    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rhvj2"]
Nov 02 17:39:58.763467 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:39:58.763439    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563fcb27_3a4d_4348_a663_5df435315279.slice/crio-2d9d1d30a8668faeb643c18a7f2691f4dbaeb8df74e26f4a237632e31800280f WatchSource:0}: Error finding container 2d9d1d30a8668faeb643c18a7f2691f4dbaeb8df74e26f4a237632e31800280f: Status 404 returned error can't find the container with id 2d9d1d30a8668faeb643c18a7f2691f4dbaeb8df74e26f4a237632e31800280f
Nov 02 17:39:59.315316 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:59.315275    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:39:59.315508 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:59.315367    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:39:59.315508 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:59.315430    5054 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 02 17:39:59.315508 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:59.315499    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs podName:63887114-eb90-460e-a7ed-a4bf04e4fea6 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:01.315479658 +0000 UTC m=+4.824241718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs") pod "router-default-86cdd8bc45-6t746" (UID: "63887114-eb90-460e-a7ed-a4bf04e4fea6") : secret "router-metrics-certs-default" not found
Nov 02 17:39:59.315508 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:59.315514    5054 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:59.315729 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:39:59.315583    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:01.315564264 +0000 UTC m=+4.824326324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:39:59.700624 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:59.700591    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2" event={"ID":"563fcb27-3a4d-4348-a663-5df435315279","Type":"ContainerStarted","Data":"2d9d1d30a8668faeb643c18a7f2691f4dbaeb8df74e26f4a237632e31800280f"}
Nov 02 17:39:59.701078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:59.700686    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:39:59.701078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:39:59.700719    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:40:00.241713 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.241644    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:40:00.710200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.709301    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rn4m9" event={"ID":"ff0f3fcf-4203-4f41-b835-07eb54829bc3","Type":"ContainerStarted","Data":"b3b8f4fdfcc4e10e0c5a933fcbde95ea32d7cb171abc94226f39cf240c862500"}
Nov 02 17:40:00.710200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.709368    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rn4m9" event={"ID":"ff0f3fcf-4203-4f41-b835-07eb54829bc3","Type":"ContainerStarted","Data":"56e93285bcd26353da74509cb14561f08489fbd6452c558c5f11d7501e2d1810"}
Nov 02 17:40:00.712558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.712527    5054 generic.go:356] "Generic (PLEG): container finished" podID="442db46e-32cb-4277-a51c-fae4c064c817" containerID="3337e15e68d9afb6e5025f5de1224870aee069b98e128b08af8159a8ea8d4201" exitCode=0
Nov 02 17:40:00.712689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.712604    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-j6zs5" event={"ID":"442db46e-32cb-4277-a51c-fae4c064c817","Type":"ContainerDied","Data":"3337e15e68d9afb6e5025f5de1224870aee069b98e128b08af8159a8ea8d4201"}
Nov 02 17:40:00.713030 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.713006    5054 scope.go:122] "RemoveContainer" containerID="3337e15e68d9afb6e5025f5de1224870aee069b98e128b08af8159a8ea8d4201"
Nov 02 17:40:00.714548 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.714522    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-rhvj2" event={"ID":"563fcb27-3a4d-4348-a663-5df435315279","Type":"ContainerStarted","Data":"c0c854d2b4a7345f21d9f09ddeb510a4c6a2ff5d30dab1b38cf090830ec9c23b"}
Nov 02 17:40:00.716454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.716429    5054 generic.go:356] "Generic (PLEG): container finished" podID="85ca2f8a-a233-42ed-87be-78984e39ee6f" containerID="14b62a0e66672157811b50fcf2e8de324ec9c63b74b644fde468bfdf61b55961" exitCode=0
Nov 02 17:40:00.716582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.716473    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs" event={"ID":"85ca2f8a-a233-42ed-87be-78984e39ee6f","Type":"ContainerDied","Data":"14b62a0e66672157811b50fcf2e8de324ec9c63b74b644fde468bfdf61b55961"}
Nov 02 17:40:00.716811 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.716792    5054 scope.go:122] "RemoveContainer" containerID="14b62a0e66672157811b50fcf2e8de324ec9c63b74b644fde468bfdf61b55961"
Nov 02 17:40:00.783944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.783922    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:40:00.876903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.876880    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:40:00.996697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.995762    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:40:00.996697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:00.996060    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:40:01.336422 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.336335    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:40:01.336582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.336487    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:01.336949 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:01.336926    5054 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 17:40:01.337021 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:01.337008    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls podName:20498905-a7ee-4693-af66-069c9fe67f64 nodeName:}" failed. No retries permitted until 2026-11-02 17:40:05.336988622 +0000 UTC m=+8.845750672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jb2qt" (UID: "20498905-a7ee-4693-af66-069c9fe67f64") : secret "insights-runtime-extractor-tls" not found
Nov 02 17:40:01.339230 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.339204    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63887114-eb90-460e-a7ed-a4bf04e4fea6-metrics-certs\") pod \"router-default-86cdd8bc45-6t746\" (UID: \"63887114-eb90-460e-a7ed-a4bf04e4fea6\") " pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:01.476498 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.476435    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:01.721764 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.721729    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlnh4" event={"ID":"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943","Type":"ContainerStarted","Data":"a4ac91be15625db3db096e6aa7fccac9a0fc52aefa95adc9b414d62b4a5abb7e"}
Nov 02 17:40:01.722275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.721818    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlnh4" event={"ID":"60a4d219-d7c3-4dce-b7fd-fa05c2fb7943","Type":"ContainerStarted","Data":"c64b0af253ffef2398d21b55f9be7ef1475c73d6a368dcd182528982454f722f"}
Nov 02 17:40:01.722275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.721869    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:40:01.723491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.723459    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn" event={"ID":"1096cec7-3002-445f-aa4a-0fe1a6f1fab8","Type":"ContainerStarted","Data":"9323fc29643bedf9ed41cebea4c67e626ff374963f6c928f50d5cd4661be52c8"}
Nov 02 17:40:01.723629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.723509    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-h27kn" event={"ID":"1096cec7-3002-445f-aa4a-0fe1a6f1fab8","Type":"ContainerStarted","Data":"e34ad19ceabb27f0faa710bddd2a9b7eefbfecf22278a2215195d1277407f425"}
Nov 02 17:40:01.725626 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.725294    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-j6zs5" event={"ID":"442db46e-32cb-4277-a51c-fae4c064c817","Type":"ContainerStarted","Data":"69bcc2fe17b3e3fb2aa8d616e0d8a3ebe10f7451f925ce80df6bb96d9be7cde9"}
Nov 02 17:40:01.727437 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.727414    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-hspzs" event={"ID":"85ca2f8a-a233-42ed-87be-78984e39ee6f","Type":"ContainerStarted","Data":"3f0078be07a863d45f23c924a5932ce972b25a1d231893d8ff34638d916b0876"}
Nov 02 17:40:01.728915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.728893    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-lckhg" event={"ID":"3ba0d151-94e7-450f-8b5d-3873a538a8a9","Type":"ContainerStarted","Data":"a49d8599e1c4651b667c8c1a62ed7f42b003e68a65d3b6ae6a13fb1b9199a163"}
Nov 02 17:40:01.768713 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:01.768671    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86cdd8bc45-6t746"]
Nov 02 17:40:01.771364 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:40:01.771339    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63887114_eb90_460e_a7ed_a4bf04e4fea6.slice/crio-a3e2090a5aba46ec15880c195b3d7029db31367b542cc103d160df1917969501 WatchSource:0}: Error finding container a3e2090a5aba46ec15880c195b3d7029db31367b542cc103d160df1917969501: Status 404 returned error can't find the container with id a3e2090a5aba46ec15880c195b3d7029db31367b542cc103d160df1917969501
Nov 02 17:40:02.608511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:02.608476    5054 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log" limit=1024
Nov 02 17:40:02.708442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:02.708411    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:40:02.734966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:02.734925    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86cdd8bc45-6t746" event={"ID":"63887114-eb90-460e-a7ed-a4bf04e4fea6","Type":"ContainerStarted","Data":"a952ef4d5999d7eaca5d1484b533f59f962847e1a8dac0fd433b989be690266e"}
Nov 02 17:40:02.735387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:02.735012    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86cdd8bc45-6t746" event={"ID":"63887114-eb90-460e-a7ed-a4bf04e4fea6","Type":"ContainerStarted","Data":"a3e2090a5aba46ec15880c195b3d7029db31367b542cc103d160df1917969501"}
Nov 02 17:40:03.007370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.007334    5054 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log" limit=1024
Nov 02 17:40:03.103256 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.103226    5054 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log" limit=1024
Nov 02 17:40:03.195950 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.195914    5054 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log" limit=1024
Nov 02 17:40:03.390478 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.390393    5054 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log" limit=1024
Nov 02 17:40:03.477605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.477574    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:03.480372 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:03.480352    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:04.583531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:04.583497    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:40:04.583938 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:04.583618    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:40:04.587289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:04.587268    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-lgcz9"
Nov 02 17:40:04.742640 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:04.742614    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:40:05.372686 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.372652    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:40:05.374932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.374898    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20498905-a7ee-4693-af66-069c9fe67f64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jb2qt\" (UID: \"20498905-a7ee-4693-af66-069c9fe67f64\") " pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:40:05.394823 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.394798    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jb2qt"
Nov 02 17:40:05.669782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.669758    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jb2qt"]
Nov 02 17:40:05.672564 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:40:05.672538    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20498905_a7ee_4693_af66_069c9fe67f64.slice/crio-dbe9c37cb9c598a0ec4a24ef91a3fa09682a8453ff996e0b730ba472f9c8e416 WatchSource:0}: Error finding container dbe9c37cb9c598a0ec4a24ef91a3fa09682a8453ff996e0b730ba472f9c8e416: Status 404 returned error can't find the container with id dbe9c37cb9c598a0ec4a24ef91a3fa09682a8453ff996e0b730ba472f9c8e416
Nov 02 17:40:05.752908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.752872    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jb2qt" event={"ID":"20498905-a7ee-4693-af66-069c9fe67f64","Type":"ContainerStarted","Data":"7ba22ecdc19f06e7a3a5268aadb24488fc732794c4aee0dce9f81989f8086244"}
Nov 02 17:40:05.753026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:05.752978    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jb2qt" event={"ID":"20498905-a7ee-4693-af66-069c9fe67f64","Type":"ContainerStarted","Data":"dbe9c37cb9c598a0ec4a24ef91a3fa09682a8453ff996e0b730ba472f9c8e416"}
Nov 02 17:40:06.757602 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:06.757571    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jb2qt" event={"ID":"20498905-a7ee-4693-af66-069c9fe67f64","Type":"ContainerStarted","Data":"be9c2328ab3b6645f937556dbcdea73fa5629c2e0af82c57831c2fe5c81433eb"}
Nov 02 17:40:06.853564 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:06.853489    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:06.853719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:06.853596    5054 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 17:40:06.854813 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:06.854784    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86cdd8bc45-6t746"
Nov 02 17:40:07.497044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:07.497013    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9h65q"
Nov 02 17:40:07.913867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:07.913657    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mpwgj"
Nov 02 17:40:08.769004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:08.768967    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jb2qt" event={"ID":"20498905-a7ee-4693-af66-069c9fe67f64","Type":"ContainerStarted","Data":"d5e9bfffb448746fe048cde2b342d7605678fdd23a39614b4a19d85863b15b50"}
Nov 02 17:40:10.993700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:10.993665    5054 patch_prober.go:29] interesting pod/image-registry-5fb5fdd4d9-nv2tc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Nov 02 17:40:10.994144 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:10.993727    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:40:11.474147 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.474117    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-h6j78-vm6lh"]
Nov 02 17:40:11.477534 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.477511    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.496006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.495978    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-h6j78-vm6lh"]
Nov 02 17:40:11.573040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.573004    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:40:11.625011 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.624964    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prgtq\" (UniqueName: \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.625165 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.625037    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.625165 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.625141    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.625252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.625228    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.726421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.726311    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prgtq\" (UniqueName: \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.726421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.726363    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.726421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.726392    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.726421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.726410    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.726890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.726867    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.727304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.727273    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.727822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.727803    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.736740 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.736717    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xlnh4"
Nov 02 17:40:11.742879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.742858    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prgtq\" (UniqueName: \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\") pod \"periodic-gathering-h6j78-vm6lh\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") " pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:11.790327 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:11.790296    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:40:12.073588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:12.073565    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-h6j78-vm6lh"]
Nov 02 17:40:12.076245 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:40:12.076216    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bc2622_2619_4153_b331_463aeeb3f56e.slice/crio-6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9 WatchSource:0}: Error finding container 6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9: Status 404 returned error can't find the container with id 6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9
Nov 02 17:40:12.793169 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:12.793120    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h6j78-vm6lh" event={"ID":"50bc2622-2619-4153-b331-463aeeb3f56e","Type":"ContainerStarted","Data":"518daff1843102be5cb7de709a62bd3fd63cf133c84bb8e3290674a18e634091"}
Nov 02 17:40:12.793339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:12.793184    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h6j78-vm6lh" event={"ID":"50bc2622-2619-4153-b331-463aeeb3f56e","Type":"ContainerStarted","Data":"6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9"}
Nov 02 17:40:12.811781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:12.811171    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-h6j78-vm6lh" podStartSLOduration=1.81115163 podStartE2EDuration="1.81115163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:40:12.810302663 +0000 UTC m=+16.319064731" watchObservedRunningTime="2026-11-02 17:40:12.81115163 +0000 UTC m=+16.319913695"
Nov 02 17:40:15.847880 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:15.847826    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:40:17.057835 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:17.057807    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-rhvj2_563fcb27-3a4d-4348-a663-5df435315279/networking-console-plugin/0.log"
Nov 02 17:40:17.257795 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:17.257762    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:40:17.458434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:17.458404    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/2.log"
Nov 02 17:40:17.631186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:17.631145    5054 patch_prober.go:29] interesting pod/image-registry-f6589b9bd-vlx6x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Nov 02 17:40:17.631345 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:17.631199    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:40:19.057620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:19.057591    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlnh4_60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/dns/0.log"
Nov 02 17:40:19.256811 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:19.256783    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlnh4_60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/kube-rbac-proxy/0.log"
Nov 02 17:40:19.656315 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:19.656287    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5tc5_7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/dns-node-resolver/0.log"
Nov 02 17:40:20.057315 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:20.057278    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fb5fdd4d9-nv2tc_57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/registry/0.log"
Nov 02 17:40:20.457503 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:20.457470    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f6589b9bd-vlx6x_6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/registry/0.log"
Nov 02 17:40:20.788514 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:20.788437    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:40:21.056391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:21.056305    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqvxr_cf4b7b16-845b-45bd-b139-62a876719b5c/node-ca/0.log"
Nov 02 17:40:21.258118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:21.258093    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86cdd8bc45-6t746_63887114-eb90-460e-a7ed-a4bf04e4fea6/router/0.log"
Nov 02 17:40:21.578511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:21.578482    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:40:21.857596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:21.857523    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t682l_203127f1-2169-422e-a508-793327fd6553/serve-healthcheck-canary/0.log"
Nov 02 17:40:27.034146 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.034108    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-chl28"]
Nov 02 17:40:27.076341 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.076306    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.088904 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.088799    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 17:40:27.089046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.088999    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 17:40:27.089046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.088999    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-84l5b\""
Nov 02 17:40:27.166208 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.166177    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 17:40:27.166377 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.166352    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 17:40:27.173302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173273    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-metrics-client-ca\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173313    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-tls\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173334    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v2s5\" (UniqueName: \"kubernetes.io/projected/9f681f52-04d7-42ce-8da1-908335437ae1-kube-api-access-4v2s5\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173445    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-wtmp\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173508    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-root\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173534    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173556    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-textfile\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173599    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.173700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.173634    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-sys\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274378    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-root\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274413    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274436    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-textfile\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274467    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274480    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-root\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274492    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-sys\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274533    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-sys\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274537    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-metrics-client-ca\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.274610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274602    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-tls\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274628    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v2s5\" (UniqueName: \"kubernetes.io/projected/9f681f52-04d7-42ce-8da1-908335437ae1-kube-api-access-4v2s5\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274656    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-wtmp\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274822    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-wtmp\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.274938    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-textfile\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275322 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.275198    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.275322 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.275248    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f681f52-04d7-42ce-8da1-908335437ae1-metrics-client-ca\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.277480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.277455    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-tls\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.277581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.277483    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f681f52-04d7-42ce-8da1-908335437ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.283119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.283098    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v2s5\" (UniqueName: \"kubernetes.io/projected/9f681f52-04d7-42ce-8da1-908335437ae1-kube-api-access-4v2s5\") pod \"node-exporter-chl28\" (UID: \"9f681f52-04d7-42ce-8da1-908335437ae1\") " pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.425424 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.425389    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-chl28"
Nov 02 17:40:27.457945 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:40:27.457915    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f681f52_04d7_42ce_8da1_908335437ae1.slice/crio-7c365c8f920655e88a66a8877e9fad1a6cade09e488152920e1a132cfe2723df WatchSource:0}: Error finding container 7c365c8f920655e88a66a8877e9fad1a6cade09e488152920e1a132cfe2723df: Status 404 returned error can't find the container with id 7c365c8f920655e88a66a8877e9fad1a6cade09e488152920e1a132cfe2723df
Nov 02 17:40:27.862234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:27.862152    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chl28" event={"ID":"9f681f52-04d7-42ce-8da1-908335437ae1","Type":"ContainerStarted","Data":"7c365c8f920655e88a66a8877e9fad1a6cade09e488152920e1a132cfe2723df"}
Nov 02 17:40:28.282151 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:28.282111    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:40:29.871975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:29.871939    5054 generic.go:356] "Generic (PLEG): container finished" podID="9f681f52-04d7-42ce-8da1-908335437ae1" containerID="eb284aceaa973ac1e7ede5428037873105dcfbbaba86f4229733ff1ba7fd7232" exitCode=0
Nov 02 17:40:29.872385 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:29.872029    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chl28" event={"ID":"9f681f52-04d7-42ce-8da1-908335437ae1","Type":"ContainerDied","Data":"eb284aceaa973ac1e7ede5428037873105dcfbbaba86f4229733ff1ba7fd7232"}
Nov 02 17:40:30.878661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:30.878623    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chl28" event={"ID":"9f681f52-04d7-42ce-8da1-908335437ae1","Type":"ContainerStarted","Data":"982e2a26162eed01d1eb50f5460549c61903221f5e903e177299c172679fce57"}
Nov 02 17:40:30.879082 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:30.878691    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chl28" event={"ID":"9f681f52-04d7-42ce-8da1-908335437ae1","Type":"ContainerStarted","Data":"7ed7a7c46aaed2022be546360c128991406d5aa7e87db7afe8993f5ee0943672"}
Nov 02 17:40:30.932541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:30.932490    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-chl28" podStartSLOduration=2.373857533 podStartE2EDuration="3.93247187s" totalImagesPullingTime="1.481422064s" totalInitContainerRuntime="77.192273ms" isStatefulPod=true podCreationTimestamp="2026-11-02 17:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:40:30.931799131 +0000 UTC m=+34.440561199" watchObservedRunningTime="2026-11-02 17:40:30.93247187 +0000 UTC m=+34.441233937"
Nov 02 17:40:32.711988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:32.711953    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9b9vg"
Nov 02 17:40:36.594942 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.594832    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerName="registry" containerID="cri-o://5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493" gracePeriod=30
Nov 02 17:40:36.892339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.892295    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:40:36.906252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.906216    5054 generic.go:356] "Generic (PLEG): container finished" podID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerID="5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493" exitCode=0
Nov 02 17:40:36.906405 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.906268    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"
Nov 02 17:40:36.906405 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.906304    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" event={"ID":"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf","Type":"ContainerDied","Data":"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"}
Nov 02 17:40:36.906405 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.906391    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc" event={"ID":"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf","Type":"ContainerDied","Data":"9a94d3ebe93f509444d4650e69c90b8f7af67a0c0cfcc48411f8c37dc4d144ff"}
Nov 02 17:40:36.906520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.906416    5054 scope.go:122] "RemoveContainer" containerID="5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"
Nov 02 17:40:36.916140 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.916117    5054 scope.go:122] "RemoveContainer" containerID="5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"
Nov 02 17:40:36.916549 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:36.916519    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493\": container with ID starting with 5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493 not found: ID does not exist" containerID="5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"
Nov 02 17:40:36.916675 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.916575    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493"} err="failed to get container status \"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493\": rpc error: code = NotFound desc = could not find container \"5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493\": container with ID starting with 5516abe4476f75ad4f8da4e634f12f4130598a44e3bcec62e018f44134ba5493 not found: ID does not exist"
Nov 02 17:40:36.962387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962356    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962448    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962492    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962517    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962564    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962581    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962606    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.962781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.962636    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") pod \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\" (UID: \"57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf\") "
Nov 02 17:40:36.963036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.963006    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:36.963524 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.963486    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:36.966237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.966207    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:36.966413 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.966384    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "kube-api-access-8f7nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:36.966588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.966569    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:40:36.966782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.966761    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:40:36.967421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.967323    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:36.971101 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:36.971062    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted" pod "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" (UID: "57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:40:37.064185 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064120    5054 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-image-registry-private-configuration\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064185 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064163    5054 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-trusted-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064185 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064179    5054 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-bound-sa-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064196    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f7nz\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-kube-api-access-8f7nz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064211    5054 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064220    5054 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-installation-pull-secrets\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064229    5054 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-registry-certificates\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.064408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.064238    5054 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf-ca-trust-extracted\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:37.243398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.243362    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:40:37.247672 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:37.247649    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fb5fdd4d9-nv2tc"]
Nov 02 17:40:38.613784 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:38.613747    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" path="/var/lib/kubelet/pods/57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf/volumes"
Nov 02 17:40:44.367164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.367127    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:40:44.367617 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.367312    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" podUID="7fad1209-655a-4176-b80f-a36b18d32310" containerName="insights-gathering" containerID="cri-o://0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311" gracePeriod=30
Nov 02 17:40:44.613597 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.613566    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:40:44.732273 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732239    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") pod \"7fad1209-655a-4176-b80f-a36b18d32310\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") "
Nov 02 17:40:44.732446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732305    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") pod \"7fad1209-655a-4176-b80f-a36b18d32310\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") "
Nov 02 17:40:44.732446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732337    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") pod \"7fad1209-655a-4176-b80f-a36b18d32310\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") "
Nov 02 17:40:44.732446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732405    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") pod \"7fad1209-655a-4176-b80f-a36b18d32310\" (UID: \"7fad1209-655a-4176-b80f-a36b18d32310\") "
Nov 02 17:40:44.732687 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732665    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle" pod "7fad1209-655a-4176-b80f-a36b18d32310" (UID: "7fad1209-655a-4176-b80f-a36b18d32310"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:44.732773 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732712    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path" pod "7fad1209-655a-4176-b80f-a36b18d32310" (UID: "7fad1209-655a-4176-b80f-a36b18d32310"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:40:44.732910 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.732888    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle" pod "7fad1209-655a-4176-b80f-a36b18d32310" (UID: "7fad1209-655a-4176-b80f-a36b18d32310"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:44.734660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.734641    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7" pod "7fad1209-655a-4176-b80f-a36b18d32310" (UID: "7fad1209-655a-4176-b80f-a36b18d32310"). InnerVolumeSpecName "kube-api-access-gcgx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:44.833542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.833506    5054 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-trusted-ca-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:44.833542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.833536    5054 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/7fad1209-655a-4176-b80f-a36b18d32310-archives-path\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:44.833542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.833545    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgx7\" (UniqueName: \"kubernetes.io/projected/7fad1209-655a-4176-b80f-a36b18d32310-kube-api-access-gcgx7\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:44.833753 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.833555    5054 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fad1209-655a-4176-b80f-a36b18d32310-service-ca-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:44.939205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.939172    5054 generic.go:356] "Generic (PLEG): container finished" podID="7fad1209-655a-4176-b80f-a36b18d32310" containerID="0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311" exitCode=2
Nov 02 17:40:44.939387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.939221    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-94b2v-6qnfm"
Nov 02 17:40:44.939387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.939253    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" event={"ID":"7fad1209-655a-4176-b80f-a36b18d32310","Type":"ContainerDied","Data":"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"}
Nov 02 17:40:44.939387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.939315    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-94b2v-6qnfm" event={"ID":"7fad1209-655a-4176-b80f-a36b18d32310","Type":"ContainerDied","Data":"aac6633f991668f544d7dc28874a1f17009fc33b2218aafc44ffd9783069e6b6"}
Nov 02 17:40:44.939387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.939343    5054 scope.go:122] "RemoveContainer" containerID="0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"
Nov 02 17:40:44.949061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.949042    5054 scope.go:122] "RemoveContainer" containerID="0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"
Nov 02 17:40:44.949316 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:44.949297    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311\": container with ID starting with 0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311 not found: ID does not exist" containerID="0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"
Nov 02 17:40:44.949372 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.949325    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311"} err="failed to get container status \"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311\": rpc error: code = NotFound desc = could not find container \"0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311\": container with ID starting with 0883533d51d0f8b5f336871bf76afb9936b43db7e23960f9d37412bb80742311 not found: ID does not exist"
Nov 02 17:40:44.969123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.969096    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:40:44.972989 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:44.972968    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-94b2v-6qnfm"]
Nov 02 17:40:45.834980 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:45.834941    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:40:46.617026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:46.615488    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7fad1209-655a-4176-b80f-a36b18d32310" path="/var/lib/kubelet/pods/7fad1209-655a-4176-b80f-a36b18d32310/volumes"
Nov 02 17:40:53.305119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.305043    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerName="registry" containerID="cri-o://3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18" gracePeriod=30
Nov 02 17:40:53.547648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.547622    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:40:53.611569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611494    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.611569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611548    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.611788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611578    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.611788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611599    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.611788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611639    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.611788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.611677    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.612136 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612103    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:53.612136 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612113    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:40:53.612287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612188    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.612330 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612288    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") pod \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\" (UID: \"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8\") "
Nov 02 17:40:53.612613 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612595    5054 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-trusted-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.612759 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.612736    5054 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-certificates\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.614267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.614216    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "kube-api-access-zvfhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:53.614358 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.614307    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:40:53.614406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.614377    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:53.614406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.614381    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:40:53.614476 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.614417    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:40:53.621050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.621024    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted" pod "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" (UID: "6c5488c4-85f7-46b9-923b-a2f29bf8d1d8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:40:53.713630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713596    5054 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-installation-pull-secrets\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.713630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713624    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvfhb\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-kube-api-access-zvfhb\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.713630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713634    5054 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-ca-trust-extracted\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.713833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713644    5054 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-image-registry-private-configuration\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.713833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713654    5054 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-registry-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.713833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.713663    5054 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8-bound-sa-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:40:53.977220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.977185    5054 generic.go:356] "Generic (PLEG): container finished" podID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerID="3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18" exitCode=0
Nov 02 17:40:53.977396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.977236    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x"
Nov 02 17:40:53.977396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.977254    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" event={"ID":"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8","Type":"ContainerDied","Data":"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"}
Nov 02 17:40:53.977396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.977293    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6589b9bd-vlx6x" event={"ID":"6c5488c4-85f7-46b9-923b-a2f29bf8d1d8","Type":"ContainerDied","Data":"b1f03c1c6dfe02fc35814d1f33fd2f4afcf1c962683b32a07fa8c630960c7675"}
Nov 02 17:40:53.977396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.977311    5054 scope.go:122] "RemoveContainer" containerID="3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"
Nov 02 17:40:53.986482 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.986464    5054 scope.go:122] "RemoveContainer" containerID="3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"
Nov 02 17:40:53.986741 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:40:53.986720    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18\": container with ID starting with 3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18 not found: ID does not exist" containerID="3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"
Nov 02 17:40:53.986803 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.986751    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18"} err="failed to get container status \"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18\": rpc error: code = NotFound desc = could not find container \"3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18\": container with ID starting with 3914a6e932e5eb0fa65822e847fbc11d478328c7272033ba3319ef38ef051a18 not found: ID does not exist"
Nov 02 17:40:53.999653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:53.999625    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:40:54.004812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:54.004793    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f6589b9bd-vlx6x"]
Nov 02 17:40:54.614046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:40:54.614014    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" path="/var/lib/kubelet/pods/6c5488c4-85f7-46b9-923b-a2f29bf8d1d8/volumes"
Nov 02 17:41:15.834453 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:41:15.834417    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:41:26.107010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:26.106922    5054 generic.go:356] "Generic (PLEG): container finished" podID="1520f556-1207-43c4-afad-fe19f9bbf7c0" containerID="fe4e979c0cf9db8d8c25be38f4a39a302fa04d306e7c7dbe0eb20799a52f1df7" exitCode=0
Nov 02 17:41:26.107010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:26.106997    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8" event={"ID":"1520f556-1207-43c4-afad-fe19f9bbf7c0","Type":"ContainerDied","Data":"fe4e979c0cf9db8d8c25be38f4a39a302fa04d306e7c7dbe0eb20799a52f1df7"}
Nov 02 17:41:26.107421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:26.107313    5054 scope.go:122] "RemoveContainer" containerID="fe4e979c0cf9db8d8c25be38f4a39a302fa04d306e7c7dbe0eb20799a52f1df7"
Nov 02 17:41:27.112161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:27.112127    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-scfj8" event={"ID":"1520f556-1207-43c4-afad-fe19f9bbf7c0","Type":"ContainerStarted","Data":"e5dc8a2de4c45e81346d8be862b524c465b7a14e95629c323b10b34ef3f43c16"}
Nov 02 17:41:41.166875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:41.166821    5054 generic.go:356] "Generic (PLEG): container finished" podID="50bc2622-2619-4153-b331-463aeeb3f56e" containerID="518daff1843102be5cb7de709a62bd3fd63cf133c84bb8e3290674a18e634091" exitCode=0
Nov 02 17:41:41.167297 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:41.166890    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h6j78-vm6lh" event={"ID":"50bc2622-2619-4153-b331-463aeeb3f56e","Type":"ContainerDied","Data":"518daff1843102be5cb7de709a62bd3fd63cf133c84bb8e3290674a18e634091"}
Nov 02 17:41:42.312747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.312722    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:41:42.394036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.393998    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\" (UniqueName: \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\") pod \"50bc2622-2619-4153-b331-463aeeb3f56e\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") "
Nov 02 17:41:42.394226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394066    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\") pod \"50bc2622-2619-4153-b331-463aeeb3f56e\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") "
Nov 02 17:41:42.394226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394092    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\") pod \"50bc2622-2619-4153-b331-463aeeb3f56e\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") "
Nov 02 17:41:42.394226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394136    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\") pod \"50bc2622-2619-4153-b331-463aeeb3f56e\" (UID: \"50bc2622-2619-4153-b331-463aeeb3f56e\") "
Nov 02 17:41:42.394496 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394463    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path" pod "50bc2622-2619-4153-b331-463aeeb3f56e" (UID: "50bc2622-2619-4153-b331-463aeeb3f56e"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:41:42.394496 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394489    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle" pod "50bc2622-2619-4153-b331-463aeeb3f56e" (UID: "50bc2622-2619-4153-b331-463aeeb3f56e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:41:42.394645 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.394517    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle" pod "50bc2622-2619-4153-b331-463aeeb3f56e" (UID: "50bc2622-2619-4153-b331-463aeeb3f56e"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:41:42.396317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.396287    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq" pod "50bc2622-2619-4153-b331-463aeeb3f56e" (UID: "50bc2622-2619-4153-b331-463aeeb3f56e"). InnerVolumeSpecName "kube-api-access-prgtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:41:42.495002 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.494927    5054 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50bc2622-2619-4153-b331-463aeeb3f56e-archives-path\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:41:42.495002 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.494954    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prgtq\" (UniqueName: \"kubernetes.io/projected/50bc2622-2619-4153-b331-463aeeb3f56e-kube-api-access-prgtq\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:41:42.495002 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.494971    5054 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-service-ca-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:41:42.495002 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:42.494982    5054 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bc2622-2619-4153-b331-463aeeb3f56e-trusted-ca-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:41:43.176774 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:43.176741    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h6j78-vm6lh"
Nov 02 17:41:43.176774 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:43.176755    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h6j78-vm6lh" event={"ID":"50bc2622-2619-4153-b331-463aeeb3f56e","Type":"ContainerDied","Data":"6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9"}
Nov 02 17:41:43.176994 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:41:43.176798    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aa7beaa17bc53bb37e9dfbef6d2c55b1f16a10bb1dae1f870248e6cb01ce7f9"
Nov 02 17:41:45.833828 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:41:45.833785    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:42:15.834432 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:42:15.834351    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:42:45.834879 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:42:45.834822    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:43:15.834342 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:43:15.834296    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:43:27.090604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090566    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"]
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090920    5054 cpu_manager.go:414] "containerMap: removing container" podUID="50bc2622-2619-4153-b331-463aeeb3f56e" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090933    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50bc2622-2619-4153-b331-463aeeb3f56e" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090944    5054 cpu_manager.go:414] "containerMap: removing container" podUID="7fad1209-655a-4176-b80f-a36b18d32310" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090949    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fad1209-655a-4176-b80f-a36b18d32310" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090957    5054 cpu_manager.go:414] "containerMap: removing container" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerName="registry"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090962    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerName="registry"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090983    5054 cpu_manager.go:414] "containerMap: removing container" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerName="registry"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.090988    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerName="registry"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.091041    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="50bc2622-2619-4153-b331-463aeeb3f56e" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.091049    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fad1209-655a-4176-b80f-a36b18d32310" containerName="insights-gathering"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.091055    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="57f86cf5-b7ad-4dbb-a6d7-4b2ccb808acf" containerName="registry"
Nov 02 17:43:27.091128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.091064    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c5488c4-85f7-46b9-923b-a2f29bf8d1d8" containerName="registry"
Nov 02 17:43:27.094199 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.094182    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.101148 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.101130    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 02 17:43:27.101236 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.101147    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 02 17:43:27.108286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.108266    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"]
Nov 02 17:43:27.135112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.135087    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-mwdx9\""
Nov 02 17:43:27.190113 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.190081    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.190217 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.190117    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.190217 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.190138    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbz52\" (UniqueName: \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.291388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.291356    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.291388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.291386    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.291573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.291409    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbz52\" (UniqueName: \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.291773 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.291750    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.291813 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.291800    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.300922 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.300902    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbz52\" (UniqueName: \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.410333 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.410262    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:27.682586 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:27.682552    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"]
Nov 02 17:43:27.685314 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:27.685287    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cf053f_7233_4b06_b33e_0a73f2eb9b2f.slice/crio-a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06 WatchSource:0}: Error finding container a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06: Status 404 returned error can't find the container with id a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06
Nov 02 17:43:28.584890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.584853    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc" event={"ID":"45cf053f-7233-4b06-b33e-0a73f2eb9b2f","Type":"ContainerStarted","Data":"a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06"}
Nov 02 17:43:28.852618 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.852523    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"]
Nov 02 17:43:28.856150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.856125    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:28.860938 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.860903    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-596hx\""
Nov 02 17:43:28.867372 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.867350    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"]
Nov 02 17:43:28.951855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.951812    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"]
Nov 02 17:43:28.955729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.955705    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:28.966413 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.966389    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"]
Nov 02 17:43:28.966560 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:28.966527    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-vqxgl\""
Nov 02 17:43:29.005882 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.005816    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.006040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.005886    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5qx\" (UniqueName: \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.006132 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.006070    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.053266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.053228    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"]
Nov 02 17:43:29.057133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.057113    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.063023 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.063001    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-djg6x\""
Nov 02 17:43:29.068293 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.068270    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"]
Nov 02 17:43:29.107061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.106985    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.107061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107028    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.107240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107079    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.107240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107181    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5qx\" (UniqueName: \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.107359 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107262    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.107359 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107296    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpx65\" (UniqueName: \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.107420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107408    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.107458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.107436    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.124798 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.124769    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5qx\" (UniqueName: \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.156080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.156050    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"]
Nov 02 17:43:29.159876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.159857    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.165872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.165828    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-n29dr\""
Nov 02 17:43:29.169111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.169087    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"]
Nov 02 17:43:29.175380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.175354    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:29.208326 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208296    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.208455 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208346    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpx65\" (UniqueName: \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.208455 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208418    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmzs\" (UniqueName: \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.208573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208450    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.208573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208483    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.208573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208509    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.208908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208871    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.208996 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.208910    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.221493 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.221462    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpx65\" (UniqueName: \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.278223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.278188    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:29.309804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.309767    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmzs\" (UniqueName: \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.309964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.309820    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.309964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.309880    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.309964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.309908    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.310070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.309969    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8zq4\" (UniqueName: \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.310070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.310050    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.311535 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.311506    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.311795 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.311775    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.320391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.320359    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmzs\" (UniqueName: \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.376207 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.376130    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:29.410878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.410703    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8zq4\" (UniqueName: \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.410878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.410815    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.411108 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.410888    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.411292 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.411271    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.411374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.411310    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.422225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.422174    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8zq4\" (UniqueName: \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.460364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.460334    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"]
Nov 02 17:43:29.468867 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:29.468546    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe91f490_9f34_4a31_a406_a2feeb37fea1.slice/crio-6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de WatchSource:0}: Error finding container 6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de: Status 404 returned error can't find the container with id 6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de
Nov 02 17:43:29.478143 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.478118    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:29.572736 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.572680    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"]
Nov 02 17:43:29.592779 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.592700    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66" event={"ID":"823541f0-7b96-425a-8bfb-55ffa4eb0a2a","Type":"ContainerStarted","Data":"04583fc4ba9c5b03b0897a6a03239c4220ee5a6288c135918d1a70e31d85af14"}
Nov 02 17:43:29.594080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.594050    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc" event={"ID":"be91f490-9f34-4a31-a406-a2feeb37fea1","Type":"ContainerStarted","Data":"6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de"}
Nov 02 17:43:29.662282 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.662194    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"]
Nov 02 17:43:29.665369 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:29.665338    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82308d82_7c06_4a1a_99b6_543dffeaed7a.slice/crio-1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a WatchSource:0}: Error finding container 1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a: Status 404 returned error can't find the container with id 1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a
Nov 02 17:43:29.763261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:29.763220    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"]
Nov 02 17:43:29.766507 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:29.766465    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78546a3_6d5e_41c0_a7b1_b82fd532c0dc.slice/crio-a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f WatchSource:0}: Error finding container a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f: Status 404 returned error can't find the container with id a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f
Nov 02 17:43:30.605362 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.605258    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98" event={"ID":"82308d82-7c06-4a1a-99b6-543dffeaed7a","Type":"ContainerStarted","Data":"1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a"}
Nov 02 17:43:30.607390 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.607360    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7" event={"ID":"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc","Type":"ContainerStarted","Data":"a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f"}
Nov 02 17:43:30.711981 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.711946    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"]
Nov 02 17:43:30.716554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.716150    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.729685 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.729006    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"]
Nov 02 17:43:30.744363 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.744342    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-vww9b\""
Nov 02 17:43:30.816184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.814796    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"]
Nov 02 17:43:30.819163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.818274    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.826022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.825925    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-7ddh4\""
Nov 02 17:43:30.826022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.826000    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 02 17:43:30.830786 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.830750    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.830966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.830911    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.830966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.830956    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rg4h\" (UniqueName: \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.853297 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.853264    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"]
Nov 02 17:43:30.931434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931399    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931444    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931495    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080990cb-5318-4cba-917d-35766ec311f3-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931528    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931549    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931586    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931612    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931637    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29tb\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-kube-api-access-g29tb\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931694    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rg4h\" (UniqueName: \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931734    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931774    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080990cb-5318-4cba-917d-35766ec311f3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.931958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.931802    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:30.932361 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.932335    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.932980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.932956    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.953213 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.953179    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rg4h\" (UniqueName: \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:30.963394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.963360    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"]
Nov 02 17:43:30.976205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.976182    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:30.985974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.985017    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"]
Nov 02 17:43:30.989788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:30.989767    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zplmb\""
Nov 02 17:43:31.033313 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033283    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080990cb-5318-4cba-917d-35766ec311f3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033317    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033353    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033377    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033416    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080990cb-5318-4cba-917d-35766ec311f3-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033449    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033475    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033815 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033514    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.033815 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.033541    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29tb\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-kube-api-access-g29tb\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.034161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.034134    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080990cb-5318-4cba-917d-35766ec311f3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.034994 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.034953    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.035090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.035043    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.035300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.035279    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.035779 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.035737    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.038179 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.038135    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080990cb-5318-4cba-917d-35766ec311f3-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.041564 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.040964    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:31.046782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.045008    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.046782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.045420    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080990cb-5318-4cba-917d-35766ec311f3-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.060102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.048192    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29tb\" (UniqueName: \"kubernetes.io/projected/080990cb-5318-4cba-917d-35766ec311f3-kube-api-access-g29tb\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp\" (UID: \"080990cb-5318-4cba-917d-35766ec311f3\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.135852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.135801    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136570    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136633    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnxp\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-kube-api-access-9bnxp\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136667    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136696    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136742    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136784    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136828    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136882    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.137126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.136914    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb081cae-ffe6-4842-82fc-acd8683d6e87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237446    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237480    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237506    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237531    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237555    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237581    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237602    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb081cae-ffe6-4842-82fc-acd8683d6e87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237624    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.237651    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnxp\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-kube-api-access-9bnxp\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.238237    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.238546    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.238868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.238797    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.239830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.239059    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.239830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.239792    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb081cae-ffe6-4842-82fc-acd8683d6e87-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.242270 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.242235    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.244700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.244656    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.270807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.270776    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnxp\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-kube-api-access-9bnxp\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.271513 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.271486    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb081cae-ffe6-4842-82fc-acd8683d6e87-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2h5cq\" (UID: \"cb081cae-ffe6-4842-82fc-acd8683d6e87\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.302762 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.302501    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:31.345387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.345304    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"]
Nov 02 17:43:31.454971 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.454929    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"]
Nov 02 17:43:31.459062 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:31.459019    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080990cb_5318_4cba_917d_35766ec311f3.slice/crio-82594eb6f812a8b6b96b23447c2ca390613de2c9bcc4621c820ca49394d33b9f WatchSource:0}: Error finding container 82594eb6f812a8b6b96b23447c2ca390613de2c9bcc4621c820ca49394d33b9f: Status 404 returned error can't find the container with id 82594eb6f812a8b6b96b23447c2ca390613de2c9bcc4621c820ca49394d33b9f
Nov 02 17:43:31.600426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.600355    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"]
Nov 02 17:43:31.604748 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:43:31.604712    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb081cae_ffe6_4842_82fc_acd8683d6e87.slice/crio-3b443dd2b06bd7347dd016412bbd90cc2708e56c2cd8e8fe7aae2bea0fe95b93 WatchSource:0}: Error finding container 3b443dd2b06bd7347dd016412bbd90cc2708e56c2cd8e8fe7aae2bea0fe95b93: Status 404 returned error can't find the container with id 3b443dd2b06bd7347dd016412bbd90cc2708e56c2cd8e8fe7aae2bea0fe95b93
Nov 02 17:43:31.617425 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.617390    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" event={"ID":"cb081cae-ffe6-4842-82fc-acd8683d6e87","Type":"ContainerStarted","Data":"3b443dd2b06bd7347dd016412bbd90cc2708e56c2cd8e8fe7aae2bea0fe95b93"}
Nov 02 17:43:31.619283 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.619256    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp" event={"ID":"080990cb-5318-4cba-917d-35766ec311f3","Type":"ContainerStarted","Data":"82594eb6f812a8b6b96b23447c2ca390613de2c9bcc4621c820ca49394d33b9f"}
Nov 02 17:43:31.622043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:31.622020    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c" event={"ID":"aed38328-b145-49b1-a910-969f0aa2f68d","Type":"ContainerStarted","Data":"a51eb72eb00745e07a1c28b80bf5dd2aa0a3729eb7a6818f89002f47d8b3a090"}
Nov 02 17:43:38.828105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:38.827338    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:38.828105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:38.827429    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:38.828105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:38.827476    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:39.184051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.183540    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:39.184051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.183620    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:39.184051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.183657    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:43:39.706054 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.705124    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" event={"ID":"cb081cae-ffe6-4842-82fc-acd8683d6e87","Type":"ContainerStarted","Data":"c4dd2a2381fd941cfde193e5af8c3e85e8cb4b94c21f30c26b158cbf7c186877"}
Nov 02 17:43:39.709776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.709734    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp" event={"ID":"080990cb-5318-4cba-917d-35766ec311f3","Type":"ContainerStarted","Data":"2965aed69f36843ff19fd136a146db7a27083fdaff64436475662f2be084ef72"}
Nov 02 17:43:39.759917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.759851    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp" podStartSLOduration=2.396147154 podStartE2EDuration="9.759818128s" totalImagesPullingTime="7.363670974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:43:39.759697686 +0000 UTC m=+223.268459754" watchObservedRunningTime="2026-11-02 17:43:39.759818128 +0000 UTC m=+223.268580196"
Nov 02 17:43:39.760299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:39.760247    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podStartSLOduration=2.18647503 podStartE2EDuration="9.76023348s" totalImagesPullingTime="7.57375845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:43:39.730819574 +0000 UTC m=+223.239581641" watchObservedRunningTime="2026-11-02 17:43:39.76023348 +0000 UTC m=+223.268995748"
Nov 02 17:43:40.138440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.136975    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:40.142249 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.142227    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:40.303691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.303595    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:40.309491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.309461    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:40.718868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.718259    5054 generic.go:356] "Generic (PLEG): container finished" podID="aed38328-b145-49b1-a910-969f0aa2f68d" containerID="238346aff9127d37f7b1c097110a9d68c025d77e105e6b4d8911c05b78cf80d2" exitCode=0
Nov 02 17:43:40.718868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.718351    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c" event={"ID":"aed38328-b145-49b1-a910-969f0aa2f68d","Type":"ContainerDied","Data":"238346aff9127d37f7b1c097110a9d68c025d77e105e6b4d8911c05b78cf80d2"}
Nov 02 17:43:40.725220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.722301    5054 generic.go:356] "Generic (PLEG): container finished" podID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerID="f8a64b622800c3880c8c6143dd9b64924ea9f0ad36d5e6797e36c6b3a13cb087" exitCode=0
Nov 02 17:43:40.725220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.724236    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc" event={"ID":"45cf053f-7233-4b06-b33e-0a73f2eb9b2f","Type":"ContainerDied","Data":"f8a64b622800c3880c8c6143dd9b64924ea9f0ad36d5e6797e36c6b3a13cb087"}
Nov 02 17:43:40.725220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.724274    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:40.725220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.725017    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:40.726103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.726037    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp"
Nov 02 17:43:40.726455 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:40.726413    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:43:41.733827 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:41.733790    5054 generic.go:356] "Generic (PLEG): container finished" podID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerID="ea4b40b5fdf44a910d479a040f0bd01da92f679914b4085a1d4f56a0c00f1595" exitCode=0
Nov 02 17:43:41.734796 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:41.734769    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc" event={"ID":"45cf053f-7233-4b06-b33e-0a73f2eb9b2f","Type":"ContainerDied","Data":"ea4b40b5fdf44a910d479a040f0bd01da92f679914b4085a1d4f56a0c00f1595"}
Nov 02 17:43:43.752793 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.752708    5054 generic.go:356] "Generic (PLEG): container finished" podID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerID="dae4c55bc14e3e04da10e4b23c27e3943232d9d1cf7f130d97eb327c19a02403" exitCode=0
Nov 02 17:43:43.752793 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.752785    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66" event={"ID":"823541f0-7b96-425a-8bfb-55ffa4eb0a2a","Type":"ContainerDied","Data":"dae4c55bc14e3e04da10e4b23c27e3943232d9d1cf7f130d97eb327c19a02403"}
Nov 02 17:43:43.754637 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.754611    5054 generic.go:356] "Generic (PLEG): container finished" podID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerID="18433d9077c0142a0a64c65692e5409324236445d71b2bc797c5d40b27ad81b9" exitCode=0
Nov 02 17:43:43.754916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.754859    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98" event={"ID":"82308d82-7c06-4a1a-99b6-543dffeaed7a","Type":"ContainerDied","Data":"18433d9077c0142a0a64c65692e5409324236445d71b2bc797c5d40b27ad81b9"}
Nov 02 17:43:43.757804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.757780    5054 generic.go:356] "Generic (PLEG): container finished" podID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerID="6314ef2878ada2ea7c6c725513624067dfe4ed52c977a9133a0e15195c6f5e73" exitCode=0
Nov 02 17:43:43.757908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.757876    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc" event={"ID":"be91f490-9f34-4a31-a406-a2feeb37fea1","Type":"ContainerDied","Data":"6314ef2878ada2ea7c6c725513624067dfe4ed52c977a9133a0e15195c6f5e73"}
Nov 02 17:43:43.760259 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.760167    5054 generic.go:356] "Generic (PLEG): container finished" podID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerID="61d9fd0ba2110da2ab0de761d28266359fd505e02c4e7e8975a93ade24b378cf" exitCode=0
Nov 02 17:43:43.760259 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:43.760225    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7" event={"ID":"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc","Type":"ContainerDied","Data":"61d9fd0ba2110da2ab0de761d28266359fd505e02c4e7e8975a93ade24b378cf"}
Nov 02 17:43:44.769673 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:44.769648    5054 generic.go:356] "Generic (PLEG): container finished" podID="aed38328-b145-49b1-a910-969f0aa2f68d" containerID="54bef9f6f6507213d2cdc8bc57c512c19be31eb984e25bd4190f87a9cb94a72d" exitCode=0
Nov 02 17:43:44.770011 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:44.769738    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c" event={"ID":"aed38328-b145-49b1-a910-969f0aa2f68d","Type":"ContainerDied","Data":"54bef9f6f6507213d2cdc8bc57c512c19be31eb984e25bd4190f87a9cb94a72d"}
Nov 02 17:43:45.778211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.778178    5054 generic.go:356] "Generic (PLEG): container finished" podID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerID="6cc76924244496e9d60be3a68471e22c6414bbe3a211c029f9d96bd0992ebb53" exitCode=0
Nov 02 17:43:45.778709 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.778303    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66" event={"ID":"823541f0-7b96-425a-8bfb-55ffa4eb0a2a","Type":"ContainerDied","Data":"6cc76924244496e9d60be3a68471e22c6414bbe3a211c029f9d96bd0992ebb53"}
Nov 02 17:43:45.780792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.780763    5054 generic.go:356] "Generic (PLEG): container finished" podID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerID="a84092d18709fdc6a00dbc70147813bf7afc68e8d7158a6eac4527caf7a20c2a" exitCode=0
Nov 02 17:43:45.780927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.780868    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98" event={"ID":"82308d82-7c06-4a1a-99b6-543dffeaed7a","Type":"ContainerDied","Data":"a84092d18709fdc6a00dbc70147813bf7afc68e8d7158a6eac4527caf7a20c2a"}
Nov 02 17:43:45.783899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.783873    5054 generic.go:356] "Generic (PLEG): container finished" podID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerID="64ee00719934f3e764bd1fadee221b2af19c64a628e11864bb781dee6d7edcb0" exitCode=0
Nov 02 17:43:45.784069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.784000    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc" event={"ID":"be91f490-9f34-4a31-a406-a2feeb37fea1","Type":"ContainerDied","Data":"64ee00719934f3e764bd1fadee221b2af19c64a628e11864bb781dee6d7edcb0"}
Nov 02 17:43:45.786366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.786330    5054 generic.go:356] "Generic (PLEG): container finished" podID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerID="d30d3157ce92a3b26c7b46c91e466560e92bb3ebf0c49fa298cb066e750f97a5" exitCode=0
Nov 02 17:43:45.786468 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:45.786390    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7" event={"ID":"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc","Type":"ContainerDied","Data":"d30d3157ce92a3b26c7b46c91e466560e92bb3ebf0c49fa298cb066e750f97a5"}
Nov 02 17:43:45.846178 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:43:45.846105    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:43:52.843460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:52.843372    5054 generic.go:356] "Generic (PLEG): container finished" podID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerID="951a597795a674b27627adc57c4538998ee52f4a7a7ff611791491d4f09048c7" exitCode=0
Nov 02 17:43:52.844052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:52.843476    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc" event={"ID":"45cf053f-7233-4b06-b33e-0a73f2eb9b2f","Type":"ContainerDied","Data":"951a597795a674b27627adc57c4538998ee52f4a7a7ff611791491d4f09048c7"}
Nov 02 17:43:53.851128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.851041    5054 generic.go:356] "Generic (PLEG): container finished" podID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerID="16045ef916417c05fef5c44f65e65ae4b1de5b44653c7898bf1f3988009879e6" exitCode=0
Nov 02 17:43:53.851597 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.851122    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66" event={"ID":"823541f0-7b96-425a-8bfb-55ffa4eb0a2a","Type":"ContainerDied","Data":"16045ef916417c05fef5c44f65e65ae4b1de5b44653c7898bf1f3988009879e6"}
Nov 02 17:43:53.853539 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.853507    5054 generic.go:356] "Generic (PLEG): container finished" podID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerID="b35bafdb310adbb98f0c6dacd303c470cf1034b2afae05fc2eaf0aab202fa0a3" exitCode=0
Nov 02 17:43:53.853662 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.853595    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98" event={"ID":"82308d82-7c06-4a1a-99b6-543dffeaed7a","Type":"ContainerDied","Data":"b35bafdb310adbb98f0c6dacd303c470cf1034b2afae05fc2eaf0aab202fa0a3"}
Nov 02 17:43:53.856026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.855996    5054 generic.go:356] "Generic (PLEG): container finished" podID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerID="1ddcfc1d3b50f0ca7f91d2f68f284a9d8c6a50298874e097486d86e66030f50c" exitCode=0
Nov 02 17:43:53.856160 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.856113    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc" event={"ID":"be91f490-9f34-4a31-a406-a2feeb37fea1","Type":"ContainerDied","Data":"1ddcfc1d3b50f0ca7f91d2f68f284a9d8c6a50298874e097486d86e66030f50c"}
Nov 02 17:43:53.858391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.858363    5054 generic.go:356] "Generic (PLEG): container finished" podID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerID="0968d7b1bd9c21005192eb2107de15a3754940b47ae7fe2bb70f71f0aac28522" exitCode=0
Nov 02 17:43:53.858512 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.858437    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7" event={"ID":"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc","Type":"ContainerDied","Data":"0968d7b1bd9c21005192eb2107de15a3754940b47ae7fe2bb70f71f0aac28522"}
Nov 02 17:43:53.994402 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:53.994371    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:54.071578 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.071537    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\" (UniqueName: \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\") pod \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") "
Nov 02 17:43:54.071742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.071607    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\") pod \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") "
Nov 02 17:43:54.071742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.071670    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\") pod \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\" (UID: \"45cf053f-7233-4b06-b33e-0a73f2eb9b2f\") "
Nov 02 17:43:54.072395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.072361    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle" pod "45cf053f-7233-4b06-b33e-0a73f2eb9b2f" (UID: "45cf053f-7233-4b06-b33e-0a73f2eb9b2f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:54.074081 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.074051    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52" pod "45cf053f-7233-4b06-b33e-0a73f2eb9b2f" (UID: "45cf053f-7233-4b06-b33e-0a73f2eb9b2f"). InnerVolumeSpecName "kube-api-access-fbz52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:54.077223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.077198    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util" pod "45cf053f-7233-4b06-b33e-0a73f2eb9b2f" (UID: "45cf053f-7233-4b06-b33e-0a73f2eb9b2f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:54.172724 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.172684    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:54.172724 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.172725    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbz52\" (UniqueName: \"kubernetes.io/projected/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-kube-api-access-fbz52\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:54.172971 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.172739    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cf053f-7233-4b06-b33e-0a73f2eb9b2f-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:54.865670 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.865616    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc"
Nov 02 17:43:54.865670 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.865652    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71l2gnc" event={"ID":"45cf053f-7233-4b06-b33e-0a73f2eb9b2f","Type":"ContainerDied","Data":"a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06"}
Nov 02 17:43:54.866212 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:54.865701    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a52cfa662f7b062ad0f204fe98f08cfb10d67666df1671fdca3101828ea07e06"
Nov 02 17:43:55.035656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.034239    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:55.063866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.059460    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:55.091899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.091875    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:55.095415 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.095392    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:55.182036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.181943    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\" (UniqueName: \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\") pod \"82308d82-7c06-4a1a-99b6-543dffeaed7a\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") "
Nov 02 17:43:55.182036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.181996    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\") pod \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182069    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\" (UniqueName: \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\") pod \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182095    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\") pod \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182131    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\" (UniqueName: \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\") pod \"be91f490-9f34-4a31-a406-a2feeb37fea1\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182169    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\") pod \"82308d82-7c06-4a1a-99b6-543dffeaed7a\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182204    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\") pod \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") "
Nov 02 17:43:55.182251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182243    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\") pod \"be91f490-9f34-4a31-a406-a2feeb37fea1\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") "
Nov 02 17:43:55.182554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182285    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\") pod \"82308d82-7c06-4a1a-99b6-543dffeaed7a\" (UID: \"82308d82-7c06-4a1a-99b6-543dffeaed7a\") "
Nov 02 17:43:55.182554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182321    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\") pod \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\" (UID: \"823541f0-7b96-425a-8bfb-55ffa4eb0a2a\") "
Nov 02 17:43:55.182554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182369    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\" (UniqueName: \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\") pod \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\" (UID: \"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc\") "
Nov 02 17:43:55.182554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.182413    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\") pod \"be91f490-9f34-4a31-a406-a2feeb37fea1\" (UID: \"be91f490-9f34-4a31-a406-a2feeb37fea1\") "
Nov 02 17:43:55.183524 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.183482    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle" pod "be91f490-9f34-4a31-a406-a2feeb37fea1" (UID: "be91f490-9f34-4a31-a406-a2feeb37fea1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.184221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.183797    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle" pod "823541f0-7b96-425a-8bfb-55ffa4eb0a2a" (UID: "823541f0-7b96-425a-8bfb-55ffa4eb0a2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.184902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.184674    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle" pod "82308d82-7c06-4a1a-99b6-543dffeaed7a" (UID: "82308d82-7c06-4a1a-99b6-543dffeaed7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.185289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.185256    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle" pod "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" (UID: "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.186377 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.186132    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4" pod "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" (UID: "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc"). InnerVolumeSpecName "kube-api-access-j8zq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:55.187668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.187618    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs" pod "82308d82-7c06-4a1a-99b6-543dffeaed7a" (UID: "82308d82-7c06-4a1a-99b6-543dffeaed7a"). InnerVolumeSpecName "kube-api-access-gpmzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:55.188548 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.188527    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65" pod "823541f0-7b96-425a-8bfb-55ffa4eb0a2a" (UID: "823541f0-7b96-425a-8bfb-55ffa4eb0a2a"). InnerVolumeSpecName "kube-api-access-cpx65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:55.189386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.189329    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx" pod "be91f490-9f34-4a31-a406-a2feeb37fea1" (UID: "be91f490-9f34-4a31-a406-a2feeb37fea1"). InnerVolumeSpecName "kube-api-access-rc5qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:55.189767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.189739    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util" pod "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" (UID: "d78546a3-6d5e-41c0-a7b1-b82fd532c0dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.192510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.192483    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util" pod "82308d82-7c06-4a1a-99b6-543dffeaed7a" (UID: "82308d82-7c06-4a1a-99b6-543dffeaed7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.193483 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.193456    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util" pod "be91f490-9f34-4a31-a406-a2feeb37fea1" (UID: "be91f490-9f34-4a31-a406-a2feeb37fea1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.195631 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.195590    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util" pod "823541f0-7b96-425a-8bfb-55ffa4eb0a2a" (UID: "823541f0-7b96-425a-8bfb-55ffa4eb0a2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:55.283225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283184    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8zq4\" (UniqueName: \"kubernetes.io/projected/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-kube-api-access-j8zq4\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283220    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283231    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpmzs\" (UniqueName: \"kubernetes.io/projected/82308d82-7c06-4a1a-99b6-543dffeaed7a-kube-api-access-gpmzs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283240    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283249    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpx65\" (UniqueName: \"kubernetes.io/projected/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-kube-api-access-cpx65\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283257    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d78546a3-6d5e-41c0-a7b1-b82fd532c0dc-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283266    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc5qx\" (UniqueName: \"kubernetes.io/projected/be91f490-9f34-4a31-a406-a2feeb37fea1-kube-api-access-rc5qx\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283274    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283282    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283288    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be91f490-9f34-4a31-a406-a2feeb37fea1-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283296    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82308d82-7c06-4a1a-99b6-543dffeaed7a-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.283443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.283303    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/823541f0-7b96-425a-8bfb-55ffa4eb0a2a-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:55.871511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.871422    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7"
Nov 02 17:43:55.871511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.871433    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k25q7" event={"ID":"d78546a3-6d5e-41c0-a7b1-b82fd532c0dc","Type":"ContainerDied","Data":"a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f"}
Nov 02 17:43:55.871511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.871488    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0562932c3f0f6e81c2401469a91fd25a288ac9be0a7e246d351430510fe7d9f"
Nov 02 17:43:55.873436 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.873414    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66" event={"ID":"823541f0-7b96-425a-8bfb-55ffa4eb0a2a","Type":"ContainerDied","Data":"04583fc4ba9c5b03b0897a6a03239c4220ee5a6288c135918d1a70e31d85af14"}
Nov 02 17:43:55.873543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.873440    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sxj66"
Nov 02 17:43:55.873543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.873455    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04583fc4ba9c5b03b0897a6a03239c4220ee5a6288c135918d1a70e31d85af14"
Nov 02 17:43:55.875507 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.875481    5054 generic.go:356] "Generic (PLEG): container finished" podID="aed38328-b145-49b1-a910-969f0aa2f68d" containerID="1fe113a90fc9d3c5cfc42c6e2dd5446a0666b22752b825adad5c36e9cf5c26f1" exitCode=0
Nov 02 17:43:55.875635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.875563    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c" event={"ID":"aed38328-b145-49b1-a910-969f0aa2f68d","Type":"ContainerDied","Data":"1fe113a90fc9d3c5cfc42c6e2dd5446a0666b22752b825adad5c36e9cf5c26f1"}
Nov 02 17:43:55.877378 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.877344    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98" event={"ID":"82308d82-7c06-4a1a-99b6-543dffeaed7a","Type":"ContainerDied","Data":"1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a"}
Nov 02 17:43:55.877378 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.877360    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avzp98"
Nov 02 17:43:55.877720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.877385    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b05536726d4863bc5b61720d6bafd6050a6631ebd7df33a392c29c86f80295a"
Nov 02 17:43:55.879242 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.879221    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc" event={"ID":"be91f490-9f34-4a31-a406-a2feeb37fea1","Type":"ContainerDied","Data":"6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de"}
Nov 02 17:43:55.879346 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.879251    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crr6nc"
Nov 02 17:43:55.879346 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:55.879258    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea7a9334dc91ffa6929635ee036ce6db60126845364771b044e6836ec9f78de"
Nov 02 17:43:57.007598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.007573    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:57.094822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.094782    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\" (UniqueName: \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\") pod \"aed38328-b145-49b1-a910-969f0aa2f68d\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") "
Nov 02 17:43:57.095069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.094863    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\") pod \"aed38328-b145-49b1-a910-969f0aa2f68d\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") "
Nov 02 17:43:57.095069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.094964    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\") pod \"aed38328-b145-49b1-a910-969f0aa2f68d\" (UID: \"aed38328-b145-49b1-a910-969f0aa2f68d\") "
Nov 02 17:43:57.095287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.095265    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle" pod "aed38328-b145-49b1-a910-969f0aa2f68d" (UID: "aed38328-b145-49b1-a910-969f0aa2f68d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:57.097088 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.097065    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h" pod "aed38328-b145-49b1-a910-969f0aa2f68d" (UID: "aed38328-b145-49b1-a910-969f0aa2f68d"). InnerVolumeSpecName "kube-api-access-8rg4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:43:57.100774 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.100752    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util" pod "aed38328-b145-49b1-a910-969f0aa2f68d" (UID: "aed38328-b145-49b1-a910-969f0aa2f68d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:43:57.195718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.195691    5054 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-bundle\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:57.195718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.195720    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rg4h\" (UniqueName: \"kubernetes.io/projected/aed38328-b145-49b1-a910-969f0aa2f68d-kube-api-access-8rg4h\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:57.195937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.195731    5054 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aed38328-b145-49b1-a910-969f0aa2f68d-util\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:43:57.889540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.889510    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c"
Nov 02 17:43:57.889709 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.889536    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e64485t5c" event={"ID":"aed38328-b145-49b1-a910-969f0aa2f68d","Type":"ContainerDied","Data":"a51eb72eb00745e07a1c28b80bf5dd2aa0a3729eb7a6818f89002f47d8b3a090"}
Nov 02 17:43:57.889709 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:43:57.889586    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a51eb72eb00745e07a1c28b80bf5dd2aa0a3729eb7a6818f89002f47d8b3a090"
Nov 02 17:44:01.261964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.261931    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"]
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262275    5054 cpu_manager.go:414] "containerMap: removing container" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262286    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262295    5054 cpu_manager.go:414] "containerMap: removing container" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="pull"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262299    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="pull"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262309    5054 cpu_manager.go:414] "containerMap: removing container" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262314    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262319    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262324    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262332    5054 cpu_manager.go:414] "containerMap: removing container" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262336    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="util"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262344    5054 cpu_manager.go:414] "containerMap: removing container" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="pull"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262350    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="pull"
Nov 02 17:44:01.262348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262357    5054 cpu_manager.go:414] "containerMap: removing container" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262362    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262370    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262374    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262383    5054 cpu_manager.go:414] "containerMap: removing container" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262387    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262393    5054 cpu_manager.go:414] "containerMap: removing container" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262397    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262403    5054 cpu_manager.go:414] "containerMap: removing container" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262407    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262413    5054 cpu_manager.go:414] "containerMap: removing container" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262417    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262426    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262430    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262435    5054 cpu_manager.go:414] "containerMap: removing container" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262439    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262446    5054 cpu_manager.go:414] "containerMap: removing container" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="util"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262451    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="util"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262459    5054 cpu_manager.go:414] "containerMap: removing container" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262463    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="pull"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262472    5054 cpu_manager.go:414] "containerMap: removing container" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="util"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262476    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="util"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262484    5054 cpu_manager.go:414] "containerMap: removing container" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262489    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262543    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="be91f490-9f34-4a31-a406-a2feeb37fea1" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262553    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="823541f0-7b96-425a-8bfb-55ffa4eb0a2a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262559    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="82308d82-7c06-4a1a-99b6-543dffeaed7a" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262564    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="45cf053f-7233-4b06-b33e-0a73f2eb9b2f" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262570    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="d78546a3-6d5e-41c0-a7b1-b82fd532c0dc" containerName="extract"
Nov 02 17:44:01.262731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.262575    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="aed38328-b145-49b1-a910-969f0aa2f68d" containerName="extract"
Nov 02 17:44:01.265896 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.265879    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.274869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.274825    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 02 17:44:01.275270 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.275245    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 02 17:44:01.276174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.276155    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 02 17:44:01.276275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.276187    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 02 17:44:01.276808 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.276793    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-nkllc\""
Nov 02 17:44:01.276882 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.276865    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328206    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328258    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328295    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328354    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb8rd\" (UniqueName: \"kubernetes.io/projected/abb47248-964b-4a1c-abfd-aac7920caf67-kube-api-access-nb8rd\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328381    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-tmp\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.328568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.328407    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-manifests\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.341272 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.341242    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"]
Nov 02 17:44:01.429636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429602    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb8rd\" (UniqueName: \"kubernetes.io/projected/abb47248-964b-4a1c-abfd-aac7920caf67-kube-api-access-nb8rd\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.429636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429643    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-tmp\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.429861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429666    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-manifests\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.429861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429700    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.429861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429802    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.430032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.429886    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.430182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.430154    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-manifests\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.432193 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.432167    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abb47248-964b-4a1c-abfd-aac7920caf67-tmp\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.432292 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.432252    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.432460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.432438    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.432497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.432439    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abb47248-964b-4a1c-abfd-aac7920caf67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.449887 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.449865    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb8rd\" (UniqueName: \"kubernetes.io/projected/abb47248-964b-4a1c-abfd-aac7920caf67-kube-api-access-nb8rd\") pod \"opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn\" (UID: \"abb47248-964b-4a1c-abfd-aac7920caf67\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.580992 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.580914    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:01.913551 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:01.913517    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb47248_964b_4a1c_abfd_aac7920caf67.slice/crio-8a4a3740b651caff66545ad610ac2f8126b28995dc52948b437e7c687b898e94 WatchSource:0}: Error finding container 8a4a3740b651caff66545ad610ac2f8126b28995dc52948b437e7c687b898e94: Status 404 returned error can't find the container with id 8a4a3740b651caff66545ad610ac2f8126b28995dc52948b437e7c687b898e94
Nov 02 17:44:01.923533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:01.923509    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"]
Nov 02 17:44:02.915421 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:02.915386    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn" event={"ID":"abb47248-964b-4a1c-abfd-aac7920caf67","Type":"ContainerStarted","Data":"8a4a3740b651caff66545ad610ac2f8126b28995dc52948b437e7c687b898e94"}
Nov 02 17:44:05.462095 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.462058    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"]
Nov 02 17:44:05.465447 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.465432    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.471898 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.471866    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 02 17:44:05.472066 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.472052    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 02 17:44:05.484633 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.484612    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-mrlgq\""
Nov 02 17:44:05.544390 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.544355    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"]
Nov 02 17:44:05.569111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.569089    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx668\" (UniqueName: \"kubernetes.io/projected/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-kube-api-access-bx668\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.569210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.569139    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-tmp\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.669956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.669924    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-tmp\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.670119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.669983    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx668\" (UniqueName: \"kubernetes.io/projected/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-kube-api-access-bx668\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.670298 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.670277    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-tmp\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.688439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.688414    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx668\" (UniqueName: \"kubernetes.io/projected/3258a0b6-66b8-40a3-bfd2-3f8e5e392b04-kube-api-access-bx668\") pod \"jobset-operator-674cd59dc5-rnkf6\" (UID: \"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.796319 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.796293    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"
Nov 02 17:44:05.931133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.931049    5054 generic.go:356] "Generic (PLEG): container finished" podID="abb47248-964b-4a1c-abfd-aac7920caf67" containerID="964d9554720c141b8a1c00889b0a421d3a05a026ed18b9890848ee8e2cf000af" exitCode=0
Nov 02 17:44:05.931133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:05.931098    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn" event={"ID":"abb47248-964b-4a1c-abfd-aac7920caf67","Type":"ContainerDied","Data":"964d9554720c141b8a1c00889b0a421d3a05a026ed18b9890848ee8e2cf000af"}
Nov 02 17:44:06.084434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:06.084405    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6"]
Nov 02 17:44:06.087529 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:06.087499    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3258a0b6_66b8_40a3_bfd2_3f8e5e392b04.slice/crio-bc5edbe5f4ed25daa234703ef31a06f87f6a5c2a422b6dd2d983950f462c6c6c WatchSource:0}: Error finding container bc5edbe5f4ed25daa234703ef31a06f87f6a5c2a422b6dd2d983950f462c6c6c: Status 404 returned error can't find the container with id bc5edbe5f4ed25daa234703ef31a06f87f6a5c2a422b6dd2d983950f462c6c6c
Nov 02 17:44:06.937364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:06.937325    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn" event={"ID":"abb47248-964b-4a1c-abfd-aac7920caf67","Type":"ContainerStarted","Data":"9fb3d571487e99fa1f64358bf664d200c90f33e74bfdeccbd55c1aa2f323a478"}
Nov 02 17:44:06.937830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:06.937439    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:06.938660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:06.938636    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6" event={"ID":"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04","Type":"ContainerStarted","Data":"bc5edbe5f4ed25daa234703ef31a06f87f6a5c2a422b6dd2d983950f462c6c6c"}
Nov 02 17:44:07.092560 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:07.092506    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn" podStartSLOduration=1.700409262 podStartE2EDuration="6.092491316s" totalImagesPullingTime="3.91444156s" totalInitContainerRuntime="477.640494ms" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:07.08670658 +0000 UTC m=+250.595468648" watchObservedRunningTime="2026-11-02 17:44:07.092491316 +0000 UTC m=+250.601253447"
Nov 02 17:44:13.972306 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:13.972269    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6" event={"ID":"3258a0b6-66b8-40a3-bfd2-3f8e5e392b04","Type":"ContainerStarted","Data":"d711b7ea1baaadab83e6cfe5d49e69f4f45de4b304a4b4c2cca32adbf2bbed52"}
Nov 02 17:44:14.004267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:14.004218    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rnkf6" podStartSLOduration=1.822376324 podStartE2EDuration="9.004203837s" totalImagesPullingTime="7.181827513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:14.003010845 +0000 UTC m=+257.511772915" watchObservedRunningTime="2026-11-02 17:44:14.004203837 +0000 UTC m=+257.512965903"
Nov 02 17:44:15.668973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.668937    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:15.672356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.672341    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.690153 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.690132    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hswfc\""
Nov 02 17:44:15.690408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.690390    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 02 17:44:15.691277 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.691264    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 02 17:44:15.703884 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.703861    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:15.753065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.753035    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2qd\" (UniqueName: \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.753182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.753166    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.834854 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:44:15.834815    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:44:15.854392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.854364    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.854534 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.854423    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2qd\" (UniqueName: \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.854763 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.854740    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.871905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.871883    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2qd\" (UniqueName: \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bb6hc\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:15.984437 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:15.984351    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:16.272625 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:16.272494    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:16.275914 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:16.275883    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f60b5cf_03c0_4ba2_9b19_a9a9e39ee507.slice/crio-b44712cf24ca3c446f78fe1367f11c4fd121ea40e5a66659a4c6d2e9499e90a4 WatchSource:0}: Error finding container b44712cf24ca3c446f78fe1367f11c4fd121ea40e5a66659a4c6d2e9499e90a4: Status 404 returned error can't find the container with id b44712cf24ca3c446f78fe1367f11c4fd121ea40e5a66659a4c6d2e9499e90a4
Nov 02 17:44:16.993262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:16.993228    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" event={"ID":"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507","Type":"ContainerStarted","Data":"b44712cf24ca3c446f78fe1367f11c4fd121ea40e5a66659a4c6d2e9499e90a4"}
Nov 02 17:44:17.946477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:17.946447    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn"
Nov 02 17:44:19.026251 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.026207    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"]
Nov 02 17:44:19.038716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.038688    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:19.045930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.045905    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xshr6\""
Nov 02 17:44:19.054862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.054817    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 02 17:44:19.056155 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.056134    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"]
Nov 02 17:44:19.182975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.182936    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dglp\" (UniqueName: \"kubernetes.io/projected/b6ec3680-571f-49a1-b9ae-15f928e9c9ea-kube-api-access-2dglp\") pod \"dns-operator-controller-manager-8557cbdb84-lx4pv\" (UID: \"b6ec3680-571f-49a1-b9ae-15f928e9c9ea\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:19.283809 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.283725    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dglp\" (UniqueName: \"kubernetes.io/projected/b6ec3680-571f-49a1-b9ae-15f928e9c9ea-kube-api-access-2dglp\") pod \"dns-operator-controller-manager-8557cbdb84-lx4pv\" (UID: \"b6ec3680-571f-49a1-b9ae-15f928e9c9ea\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:19.297865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.297822    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dglp\" (UniqueName: \"kubernetes.io/projected/b6ec3680-571f-49a1-b9ae-15f928e9c9ea-kube-api-access-2dglp\") pod \"dns-operator-controller-manager-8557cbdb84-lx4pv\" (UID: \"b6ec3680-571f-49a1-b9ae-15f928e9c9ea\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:19.358365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.358328    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:19.662362 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:19.662335    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"]
Nov 02 17:44:19.665283 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:19.665247    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ec3680_571f_49a1_b9ae_15f928e9c9ea.slice/crio-5d56398098c0ab3cb19663da22c71160b9808673a9be78cb6a7c3f50a6698f86 WatchSource:0}: Error finding container 5d56398098c0ab3cb19663da22c71160b9808673a9be78cb6a7c3f50a6698f86: Status 404 returned error can't find the container with id 5d56398098c0ab3cb19663da22c71160b9808673a9be78cb6a7c3f50a6698f86
Nov 02 17:44:20.011649 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:20.011569    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv" event={"ID":"b6ec3680-571f-49a1-b9ae-15f928e9c9ea","Type":"ContainerStarted","Data":"5d56398098c0ab3cb19663da22c71160b9808673a9be78cb6a7c3f50a6698f86"}
Nov 02 17:44:22.028768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:22.028729    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" event={"ID":"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507","Type":"ContainerStarted","Data":"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"}
Nov 02 17:44:22.029262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:22.028867    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:22.090777 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:22.090731    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" podStartSLOduration=2.104944905 podStartE2EDuration="7.090714995s" totalImagesPullingTime="4.98577009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:22.089966339 +0000 UTC m=+265.598728405" watchObservedRunningTime="2026-11-02 17:44:22.090714995 +0000 UTC m=+265.599477062"
Nov 02 17:44:23.034916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.034878    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv" event={"ID":"b6ec3680-571f-49a1-b9ae-15f928e9c9ea","Type":"ContainerStarted","Data":"d9e059387c3fba67ff1966f5e8b4ff49e5ce79998b47b6670c8cf9dd6b82082c"}
Nov 02 17:44:23.035336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.035174    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:23.086863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.086801    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv" podStartSLOduration=2.689068631 podStartE2EDuration="5.086777698s" totalImagesPullingTime="2.397709067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:23.085600048 +0000 UTC m=+266.594362126" watchObservedRunningTime="2026-11-02 17:44:23.086777698 +0000 UTC m=+266.595539765"
Nov 02 17:44:23.368698 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.368618    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"]
Nov 02 17:44:23.370810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.370786    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:23.377905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.377881    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-98dt8\""
Nov 02 17:44:23.392833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.392812    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"]
Nov 02 17:44:23.518626 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.518589    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b96\" (UniqueName: \"kubernetes.io/projected/4652d772-051e-4436-90ea-2ca6f4bf9d6b-kube-api-access-w8b96\") pod \"authorino-operator-7b7bb4bc77-5fn6f\" (UID: \"4652d772-051e-4436-90ea-2ca6f4bf9d6b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:23.620152 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.620068    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b96\" (UniqueName: \"kubernetes.io/projected/4652d772-051e-4436-90ea-2ca6f4bf9d6b-kube-api-access-w8b96\") pod \"authorino-operator-7b7bb4bc77-5fn6f\" (UID: \"4652d772-051e-4436-90ea-2ca6f4bf9d6b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:23.637365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.637332    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b96\" (UniqueName: \"kubernetes.io/projected/4652d772-051e-4436-90ea-2ca6f4bf9d6b-kube-api-access-w8b96\") pod \"authorino-operator-7b7bb4bc77-5fn6f\" (UID: \"4652d772-051e-4436-90ea-2ca6f4bf9d6b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:23.682771 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.682741    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:23.966592 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:23.966566    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"]
Nov 02 17:44:23.968117 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:23.968088    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4652d772_051e_4436_90ea_2ca6f4bf9d6b.slice/crio-28b5cf8804dbac4a74e6a2ddd96e66e89276e3e23fa6de8031c276f2c8837438 WatchSource:0}: Error finding container 28b5cf8804dbac4a74e6a2ddd96e66e89276e3e23fa6de8031c276f2c8837438: Status 404 returned error can't find the container with id 28b5cf8804dbac4a74e6a2ddd96e66e89276e3e23fa6de8031c276f2c8837438
Nov 02 17:44:24.040565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:24.040532    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f" event={"ID":"4652d772-051e-4436-90ea-2ca6f4bf9d6b","Type":"ContainerStarted","Data":"28b5cf8804dbac4a74e6a2ddd96e66e89276e3e23fa6de8031c276f2c8837438"}
Nov 02 17:44:26.051652 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.051612    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f" event={"ID":"4652d772-051e-4436-90ea-2ca6f4bf9d6b","Type":"ContainerStarted","Data":"63bb32b3237651fb0e20767b3ea9ebb30c6f8201f73e25607579e5c0e350a7a4"}
Nov 02 17:44:26.052120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.051802    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:26.081927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.081876    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f" podStartSLOduration=1.4369937830000001 podStartE2EDuration="3.081859764s" totalImagesPullingTime="1.644865981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:26.080227146 +0000 UTC m=+269.588989213" watchObservedRunningTime="2026-11-02 17:44:26.081859764 +0000 UTC m=+269.590621831"
Nov 02 17:44:26.592076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.592038    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"]
Nov 02 17:44:26.595600 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.595578    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:26.604658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.604635    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ph9gl\""
Nov 02 17:44:26.615435 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.615412    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"]
Nov 02 17:44:26.747065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.747026    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9vr6\" (UniqueName: \"kubernetes.io/projected/5512a4e8-fecc-49fa-a7c7-b7026fa26b0e-kube-api-access-d9vr6\") pod \"limitador-operator-controller-manager-5778bb4449-9t66j\" (UID: \"5512a4e8-fecc-49fa-a7c7-b7026fa26b0e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:26.847900 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.847803    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9vr6\" (UniqueName: \"kubernetes.io/projected/5512a4e8-fecc-49fa-a7c7-b7026fa26b0e-kube-api-access-d9vr6\") pod \"limitador-operator-controller-manager-5778bb4449-9t66j\" (UID: \"5512a4e8-fecc-49fa-a7c7-b7026fa26b0e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:26.863958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.863926    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9vr6\" (UniqueName: \"kubernetes.io/projected/5512a4e8-fecc-49fa-a7c7-b7026fa26b0e-kube-api-access-d9vr6\") pod \"limitador-operator-controller-manager-5778bb4449-9t66j\" (UID: \"5512a4e8-fecc-49fa-a7c7-b7026fa26b0e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:26.908152 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:26.908111    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:27.194225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:27.194202    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"]
Nov 02 17:44:27.195631 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:27.195603    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5512a4e8_fecc_49fa_a7c7_b7026fa26b0e.slice/crio-1ded124ca1f91b20977c65ede901d9d30f212ae3afe2061b460bf5c2be4ce72a WatchSource:0}: Error finding container 1ded124ca1f91b20977c65ede901d9d30f212ae3afe2061b460bf5c2be4ce72a: Status 404 returned error can't find the container with id 1ded124ca1f91b20977c65ede901d9d30f212ae3afe2061b460bf5c2be4ce72a
Nov 02 17:44:28.061858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:28.061803    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j" event={"ID":"5512a4e8-fecc-49fa-a7c7-b7026fa26b0e","Type":"ContainerStarted","Data":"1ded124ca1f91b20977c65ede901d9d30f212ae3afe2061b460bf5c2be4ce72a"}
Nov 02 17:44:29.069180 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:29.069095    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j" event={"ID":"5512a4e8-fecc-49fa-a7c7-b7026fa26b0e","Type":"ContainerStarted","Data":"7640a0bbe27319a28bb833b281c70a89078de2e3ca26ebc7862c2e80ef4ea97f"}
Nov 02 17:44:29.069632 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:29.069229    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:29.095109 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:29.095054    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j" podStartSLOduration=1.496517712 podStartE2EDuration="3.095041034s" totalImagesPullingTime="1.598523322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:29.093712628 +0000 UTC m=+272.602474695" watchObservedRunningTime="2026-11-02 17:44:29.095041034 +0000 UTC m=+272.603803102"
Nov 02 17:44:33.038113 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.038081    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:33.570349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.570308    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 17:44:33.573630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.573614    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.594785 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.594758    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 17:44:33.600368 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.600346    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.600490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.600417    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrcj\" (UniqueName: \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.701252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.701223    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.701434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.701317    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trrcj\" (UniqueName: \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.701668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.701643    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.711850 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.711822    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrcj\" (UniqueName: \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\") pod \"kuadrant-operator-controller-manager-678d87766f-gkvzw\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:33.886309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:33.886220    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:34.043274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:34.043243    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-lx4pv"
Nov 02 17:44:34.168563 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:34.168541    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 17:44:34.170356 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:34.170325    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28096a18_58c4_4c3e_80f9_df85c4f38199.slice/crio-cda8636f43bbda148477d70b1d7ac8eaca168ce99dd62cbcb368b2bfca9deb3b WatchSource:0}: Error finding container cda8636f43bbda148477d70b1d7ac8eaca168ce99dd62cbcb368b2bfca9deb3b: Status 404 returned error can't find the container with id cda8636f43bbda148477d70b1d7ac8eaca168ce99dd62cbcb368b2bfca9deb3b
Nov 02 17:44:35.099833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.099800    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" event={"ID":"28096a18-58c4-4c3e-80f9-df85c4f38199","Type":"ContainerStarted","Data":"f5f6911f653e01ad8e0a34b4a11ab230dbd95c6ab8abfc3e0637a45b416a1156"}
Nov 02 17:44:35.100239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.099863    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" event={"ID":"28096a18-58c4-4c3e-80f9-df85c4f38199","Type":"ContainerStarted","Data":"cda8636f43bbda148477d70b1d7ac8eaca168ce99dd62cbcb368b2bfca9deb3b"}
Nov 02 17:44:35.100239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.099967    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:35.158388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.158334    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" podStartSLOduration=2.158320692 podStartE2EDuration="2.158320692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:35.157934609 +0000 UTC m=+278.666696676" watchObservedRunningTime="2026-11-02 17:44:35.158320692 +0000 UTC m=+278.667082760"
Nov 02 17:44:35.793772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.793731    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"]
Nov 02 17:44:35.797262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.797243    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.811940 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.811916    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4755w\""
Nov 02 17:44:35.816434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816411    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816526 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816442    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816578 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816540    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816609    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816692 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816634    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816692 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816667    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816786 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816698    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816786 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816720    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbl56\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-kube-api-access-tbl56\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.816912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.816817    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.826739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.826715    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"]
Nov 02 17:44:35.917205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917174    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917206    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917225    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917251    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917277    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbl56\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-kube-api-access-tbl56\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917403    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917471    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917499    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917599    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917768    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.917900 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917881    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.918006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.917986    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.918067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.918011    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.918169 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.918140    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.919787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.919762    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.919902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.919885    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.957060 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.957037    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbl56\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-kube-api-access-tbl56\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:35.957980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:35.957960    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009c4f65-25ea-4134-809b-4c5cfdda5ec3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-lk4lv\" (UID: \"009c4f65-25ea-4134-809b-4c5cfdda5ec3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:36.109410 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:36.109340    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:36.412215 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:36.412184    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"]
Nov 02 17:44:36.413811 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:44:36.413774    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009c4f65_25ea_4134_809b_4c5cfdda5ec3.slice/crio-b3bb257e0fcf87424f201112cf6af03c44b46264b645dab25b06d8384e9e4c58 WatchSource:0}: Error finding container b3bb257e0fcf87424f201112cf6af03c44b46264b645dab25b06d8384e9e4c58: Status 404 returned error can't find the container with id b3bb257e0fcf87424f201112cf6af03c44b46264b645dab25b06d8384e9e4c58
Nov 02 17:44:36.416308 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:36.416265    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:44:36.416404 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:36.416353    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:44:36.416404 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:36.416396    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:44:37.058932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:37.058900    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5fn6f"
Nov 02 17:44:37.117049 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:37.117016    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv" event={"ID":"009c4f65-25ea-4134-809b-4c5cfdda5ec3","Type":"ContainerStarted","Data":"5b004f7e8540399c64d98dc7d9cd31fcdcab4445fd11ccea164270f08746945e"}
Nov 02 17:44:37.117645 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:37.117076    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv" event={"ID":"009c4f65-25ea-4134-809b-4c5cfdda5ec3","Type":"ContainerStarted","Data":"b3bb257e0fcf87424f201112cf6af03c44b46264b645dab25b06d8384e9e4c58"}
Nov 02 17:44:37.191882 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:37.191814    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv" podStartSLOduration=2.191798245 podStartE2EDuration="2.191798245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:44:37.189889616 +0000 UTC m=+280.698651683" watchObservedRunningTime="2026-11-02 17:44:37.191798245 +0000 UTC m=+280.700560290"
Nov 02 17:44:38.109712 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:38.109678    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:38.114536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:38.114511    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:38.122325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:38.122293    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:38.123053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:38.123036    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-lk4lv"
Nov 02 17:44:40.076200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:40.076168    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9t66j"
Nov 02 17:44:45.834917 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:44:45.834874    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:44:46.107171 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.107089    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 17:44:46.171568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.171536    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:46.171885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.171853    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" podUID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" containerName="manager" containerID="cri-o://e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5" gracePeriod=10
Nov 02 17:44:46.416660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.416634    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:46.508937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.508903    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\") pod \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") "
Nov 02 17:44:46.509098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.508998    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\" (UniqueName: \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\") pod \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\" (UID: \"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507\") "
Nov 02 17:44:46.509489 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.509466    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume" pod "2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" (UID: "2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:44:46.511181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.511158    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd" pod "2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" (UID: "2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507"). InnerVolumeSpecName "kube-api-access-jh2qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:44:46.611018 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.610980    5054 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-extensions-socket-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:44:46.611018 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:46.611016    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh2qd\" (UniqueName: \"kubernetes.io/projected/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507-kube-api-access-jh2qd\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:44:47.169179 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.169139    5054 generic.go:356] "Generic (PLEG): container finished" podID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" containerID="e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5" exitCode=0
Nov 02 17:44:47.169581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.169187    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"
Nov 02 17:44:47.169581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.169217    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" event={"ID":"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507","Type":"ContainerDied","Data":"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"}
Nov 02 17:44:47.169581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.169274    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc" event={"ID":"2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507","Type":"ContainerDied","Data":"b44712cf24ca3c446f78fe1367f11c4fd121ea40e5a66659a4c6d2e9499e90a4"}
Nov 02 17:44:47.169581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.169296    5054 scope.go:122] "RemoveContainer" containerID="e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"
Nov 02 17:44:47.180045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.180025    5054 scope.go:122] "RemoveContainer" containerID="e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"
Nov 02 17:44:47.180379 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:44:47.180352    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5\": container with ID starting with e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5 not found: ID does not exist" containerID="e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"
Nov 02 17:44:47.180490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.180384    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5"} err="failed to get container status \"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5\": rpc error: code = NotFound desc = could not find container \"e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5\": container with ID starting with e407d37b85551ca6b2d028ab94bd495df38fc0b017cedde9bd13fe29d8b69ae5 not found: ID does not exist"
Nov 02 17:44:47.215149 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.215119    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:47.226610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:47.226586    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bb6hc"]
Nov 02 17:44:48.614868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:48.614817    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" path="/var/lib/kubelet/pods/2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507/volumes"
Nov 02 17:44:56.644977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:56.644952    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:44:56.645390 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:56.645147    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:44:56.647747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:56.647730    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:44:56.648049 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:44:56.648034    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:45:07.413601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.413519    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:45:07.414003 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.413963    5054 cpu_manager.go:414] "containerMap: removing container" podUID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" containerName="manager"
Nov 02 17:45:07.414003 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.413978    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" containerName="manager"
Nov 02 17:45:07.414075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.414048    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f60b5cf-03c0-4ba2-9b19-a9a9e39ee507" containerName="manager"
Nov 02 17:45:07.417154 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.417133    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:45:07.424591 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.424045    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lhbkr\""
Nov 02 17:45:07.425407 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.425382    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:45:07.489225 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.489187    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g4gg\" (UniqueName: \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\") pod \"authorino-56c6c9ddd5-876zg\" (UID: \"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:45:07.590284 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.590247    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g4gg\" (UniqueName: \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\") pod \"authorino-56c6c9ddd5-876zg\" (UID: \"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:45:07.608092 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.608060    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g4gg\" (UniqueName: \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\") pod \"authorino-56c6c9ddd5-876zg\" (UID: \"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:45:07.730123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.730043    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:45:07.895144 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.895109    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:45:07.899704 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.899683    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:07.906686 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.906662    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:45:07.908333 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.908312    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8t8g\""
Nov 02 17:45:07.924033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.924009    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 02 17:45:07.937971 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.937944    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:45:07.997233 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.997172    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/efad5adb-0281-4b41-a12e-ab8c8acdc61b-config-file\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:07.997233 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:07.997219    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfjx\" (UniqueName: \"kubernetes.io/projected/efad5adb-0281-4b41-a12e-ab8c8acdc61b-kube-api-access-vdfjx\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.003288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.003269    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:45:08.005461 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:45:08.005435    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f42deaa_7979_4ad8_b8d4_a368d4d7ba5b.slice/crio-df9c488238c06588bd851f9b4607262c93b24fe4637d719816afe9a18b9391bd WatchSource:0}: Error finding container df9c488238c06588bd851f9b4607262c93b24fe4637d719816afe9a18b9391bd: Status 404 returned error can't find the container with id df9c488238c06588bd851f9b4607262c93b24fe4637d719816afe9a18b9391bd
Nov 02 17:45:08.006789 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.006771    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 17:45:08.098441 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.098413    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfjx\" (UniqueName: \"kubernetes.io/projected/efad5adb-0281-4b41-a12e-ab8c8acdc61b-kube-api-access-vdfjx\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.098562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.098514    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/efad5adb-0281-4b41-a12e-ab8c8acdc61b-config-file\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.099177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.099158    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/efad5adb-0281-4b41-a12e-ab8c8acdc61b-config-file\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.107290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.107265    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfjx\" (UniqueName: \"kubernetes.io/projected/efad5adb-0281-4b41-a12e-ab8c8acdc61b-kube-api-access-vdfjx\") pod \"limitador-limitador-7c9b87d574-9fkg5\" (UID: \"efad5adb-0281-4b41-a12e-ab8c8acdc61b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.213872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.213820    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:08.277153 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.277114    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" event={"ID":"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b","Type":"ContainerStarted","Data":"df9c488238c06588bd851f9b4607262c93b24fe4637d719816afe9a18b9391bd"}
Nov 02 17:45:08.488200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:08.488176    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:45:08.489395 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:45:08.489366    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefad5adb_0281_4b41_a12e_ab8c8acdc61b.slice/crio-2ed6b41ba712ef9c9ed579afd66ef59a3b7f7d413e9ea17c3016c69f861ccda1 WatchSource:0}: Error finding container 2ed6b41ba712ef9c9ed579afd66ef59a3b7f7d413e9ea17c3016c69f861ccda1: Status 404 returned error can't find the container with id 2ed6b41ba712ef9c9ed579afd66ef59a3b7f7d413e9ea17c3016c69f861ccda1
Nov 02 17:45:09.286024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:09.285983    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5" event={"ID":"efad5adb-0281-4b41-a12e-ab8c8acdc61b","Type":"ContainerStarted","Data":"2ed6b41ba712ef9c9ed579afd66ef59a3b7f7d413e9ea17c3016c69f861ccda1"}
Nov 02 17:45:10.292983 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:10.292891    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5" event={"ID":"efad5adb-0281-4b41-a12e-ab8c8acdc61b","Type":"ContainerStarted","Data":"0b299de9855ca853635a7132d315b51b149f62f6b51cae27ba378cd13f472ee4"}
Nov 02 17:45:10.293434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:10.292981    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:10.294776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:10.294746    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" event={"ID":"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b","Type":"ContainerStarted","Data":"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"}
Nov 02 17:45:10.311653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:10.311607    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5" podStartSLOduration=2.041414031 podStartE2EDuration="3.311576707s" totalImagesPullingTime="1.270162676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:45:10.310097501 +0000 UTC m=+313.818859569" watchObservedRunningTime="2026-11-02 17:45:10.311576707 +0000 UTC m=+313.820338773"
Nov 02 17:45:10.325960 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:10.325915    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" podStartSLOduration=1.370354402 podStartE2EDuration="3.325904499s" totalImagesPullingTime="1.955550097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:45:10.325307755 +0000 UTC m=+313.834069822" watchObservedRunningTime="2026-11-02 17:45:10.325904499 +0000 UTC m=+313.834666598"
Nov 02 17:45:15.835136 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:45:15.835097    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:45:21.300783 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:45:21.300753    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"
Nov 02 17:45:45.834189 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:45:45.834151    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:46:15.834453 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:46:15.834415    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:46:18.989454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:18.989424    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:18.992901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:18.992882    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.003053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.002919    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 17:46:19.003053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.003019    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 17:46:19.003521 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.003502    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 17:46:19.003642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.003522    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-szhm5\""
Nov 02 17:46:19.003642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.003552    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 17:46:19.005942 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.005919    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:19.015096 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.015073    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.015195 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.015104    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.015289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.015263    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mszj9\" (UniqueName: \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.015380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.015365    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.115863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.115797    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszj9\" (UniqueName: \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.116043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.115933    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.116043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.115988    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.116043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.116021    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.116595 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.116570    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.118550 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.118522    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.118653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.118574    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.126234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.126211    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszj9\" (UniqueName: \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\") pod \"maas-api-6d669c7fcd-5w6bx\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.306239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.306161    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:19.580188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.580157    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:19.582960 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:46:19.582933    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f0d404_ee75_4452_88ee_8ad3d43812d9.slice/crio-c8695672bded89dc95baf9b766a84e54fef7765e542fd82eb65c69a44f5fc2cb WatchSource:0}: Error finding container c8695672bded89dc95baf9b766a84e54fef7765e542fd82eb65c69a44f5fc2cb: Status 404 returned error can't find the container with id c8695672bded89dc95baf9b766a84e54fef7765e542fd82eb65c69a44f5fc2cb
Nov 02 17:46:19.648897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.648824    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" event={"ID":"b7f0d404-ee75-4452-88ee-8ad3d43812d9","Type":"ContainerStarted","Data":"c8695672bded89dc95baf9b766a84e54fef7765e542fd82eb65c69a44f5fc2cb"}
Nov 02 17:46:19.841728 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:19.841642    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:46:23.697896 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:23.697828    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" event={"ID":"b7f0d404-ee75-4452-88ee-8ad3d43812d9","Type":"ContainerStarted","Data":"f6f3832ad627e23e9acb0d85c591c2e5916371a6889eaefe7fb57d47a451d956"}
Nov 02 17:46:23.698428 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:23.697980    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:23.718661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:23.718614    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" podStartSLOduration=2.683902363 podStartE2EDuration="5.718600103s" totalImagesPullingTime="3.03469774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:46:23.717314877 +0000 UTC m=+387.226076943" watchObservedRunningTime="2026-11-02 17:46:23.718600103 +0000 UTC m=+387.227362192"
Nov 02 17:46:29.708899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.708868    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:29.729817 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.729789    5054 generic.go:356] "Generic (PLEG): container finished" podID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerID="c4dd2a2381fd941cfde193e5af8c3e85e8cb4b94c21f30c26b158cbf7c186877" exitCode=0
Nov 02 17:46:29.730006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.729874    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" event={"ID":"cb081cae-ffe6-4842-82fc-acd8683d6e87","Type":"ContainerDied","Data":"c4dd2a2381fd941cfde193e5af8c3e85e8cb4b94c21f30c26b158cbf7c186877"}
Nov 02 17:46:29.730220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.730206    5054 scope.go:122] "RemoveContainer" containerID="c4dd2a2381fd941cfde193e5af8c3e85e8cb4b94c21f30c26b158cbf7c186877"
Nov 02 17:46:29.731501 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.731463    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:46:29.731642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.731544    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:46:29.731642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:29.731593    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:46:30.489309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.489266    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:30.502194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.502165    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:30.502387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.502262    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.520016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.519977    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 02 17:46:30.641794 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.641764    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.641964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.641800    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwzp\" (UniqueName: \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.737322 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.737288    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" event={"ID":"cb081cae-ffe6-4842-82fc-acd8683d6e87","Type":"ContainerStarted","Data":"aab4ddc92dd1ce3ad4a13e05d6ef0b07bf3df9df4c46c0246028652486eda0d9"}
Nov 02 17:46:30.742605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.742556    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.742605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.742590    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwzp\" (UniqueName: \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.744996 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.744978    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.750508 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.750484    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwzp\" (UniqueName: \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\") pod \"authorino-6889cbd8c4-s46z9\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") " pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.794864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.793469    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:30.794864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.793741    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:30.821986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.821958    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:46:30.830562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.830529    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:30.834972 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.834940    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:46:30.944678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.944643    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkk7p\" (UniqueName: \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:30.944867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:30.944692    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.045967 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.045879    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.046100 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.046010    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkk7p\" (UniqueName: \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.048214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.048183    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.054084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.054057    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkk7p\" (UniqueName: \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\") pod \"authorino-54c89778b8-mqnwb\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") " pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.094975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.090504    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:31.098292 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:46:31.098258    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5d4909e_5552_46c8_adcc_9087c5598dfc.slice/crio-927e384fbaec8b7cbcd3100ac69022f4241460db424afb17caac19b0443c759c WatchSource:0}: Error finding container 927e384fbaec8b7cbcd3100ac69022f4241460db424afb17caac19b0443c759c: Status 404 returned error can't find the container with id 927e384fbaec8b7cbcd3100ac69022f4241460db424afb17caac19b0443c759c
Nov 02 17:46:31.146122 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.146098    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:46:31.302963 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.302881    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:46:31.303106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.303024    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 02 17:46:31.303106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.303073    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 02 17:46:31.436073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.436049    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:46:31.437993 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:46:31.437966    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod860b5d22_a09a_4159_8b69_312bd4ed835f.slice/crio-1e5627a65d721808fe8214c84e9cc11598bd993f1c89189d2382bbc8306f0f70 WatchSource:0}: Error finding container 1e5627a65d721808fe8214c84e9cc11598bd993f1c89189d2382bbc8306f0f70: Status 404 returned error can't find the container with id 1e5627a65d721808fe8214c84e9cc11598bd993f1c89189d2382bbc8306f0f70
Nov 02 17:46:31.743690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.743653    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c89778b8-mqnwb" event={"ID":"860b5d22-a09a-4159-8b69-312bd4ed835f","Type":"ContainerStarted","Data":"1e5627a65d721808fe8214c84e9cc11598bd993f1c89189d2382bbc8306f0f70"}
Nov 02 17:46:31.745032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:31.745005    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" event={"ID":"a5d4909e-5552-46c8-adcc-9087c5598dfc","Type":"ContainerStarted","Data":"927e384fbaec8b7cbcd3100ac69022f4241460db424afb17caac19b0443c759c"}
Nov 02 17:46:32.303925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.303455    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 02 17:46:32.303925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.303518    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 02 17:46:32.760738 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.760676    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c89778b8-mqnwb" event={"ID":"860b5d22-a09a-4159-8b69-312bd4ed835f","Type":"ContainerStarted","Data":"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"}
Nov 02 17:46:32.763351 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.763313    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" event={"ID":"a5d4909e-5552-46c8-adcc-9087c5598dfc","Type":"ContainerStarted","Data":"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"}
Nov 02 17:46:32.763554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.763346    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" podUID="a5d4909e-5552-46c8-adcc-9087c5598dfc" containerName="authorino" containerID="cri-o://bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc" gracePeriod=30
Nov 02 17:46:32.816160 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.814405    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-54c89778b8-mqnwb" podStartSLOduration=2.216300555 podStartE2EDuration="2.814387037s" totalImagesPullingTime="598.086482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:46:32.787605613 +0000 UTC m=+396.296367682" watchObservedRunningTime="2026-11-02 17:46:32.814387037 +0000 UTC m=+396.323149106"
Nov 02 17:46:32.817361 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.816637    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:46:32.817361 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.816855    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" podUID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" containerName="authorino" containerID="cri-o://b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de" gracePeriod=30
Nov 02 17:46:32.819410 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:32.819353    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" podStartSLOduration=1.959073434 podStartE2EDuration="2.819339338s" totalImagesPullingTime="860.265904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:46:32.812241848 +0000 UTC m=+396.321003915" watchObservedRunningTime="2026-11-02 17:46:32.819339338 +0000 UTC m=+396.328101406"
Nov 02 17:46:33.132040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.132012    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:33.145907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.145883    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:46:33.269385 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.269355    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\" (UniqueName: \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\") pod \"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b\" (UID: \"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b\") "
Nov 02 17:46:33.269385 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.269391    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\" (UniqueName: \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\") pod \"a5d4909e-5552-46c8-adcc-9087c5598dfc\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") "
Nov 02 17:46:33.269583 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.269413    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\" (UniqueName: \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\") pod \"a5d4909e-5552-46c8-adcc-9087c5598dfc\" (UID: \"a5d4909e-5552-46c8-adcc-9087c5598dfc\") "
Nov 02 17:46:33.297481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.297388    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg" pod "7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" (UID: "7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b"). InnerVolumeSpecName "kube-api-access-7g4gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:46:33.297481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.297451    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp" pod "a5d4909e-5552-46c8-adcc-9087c5598dfc" (UID: "a5d4909e-5552-46c8-adcc-9087c5598dfc"). InnerVolumeSpecName "kube-api-access-hkwzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:46:33.303852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.303770    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 02 17:46:33.303852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.303814    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 02 17:46:33.307066 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.307042    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert" pod "a5d4909e-5552-46c8-adcc-9087c5598dfc" (UID: "a5d4909e-5552-46c8-adcc-9087c5598dfc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:46:33.394863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.394326    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g4gg\" (UniqueName: \"kubernetes.io/projected/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b-kube-api-access-7g4gg\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:33.394863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.394363    5054 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5d4909e-5552-46c8-adcc-9087c5598dfc-tls-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:33.394863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.394379    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkwzp\" (UniqueName: \"kubernetes.io/projected/a5d4909e-5552-46c8-adcc-9087c5598dfc-kube-api-access-hkwzp\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:33.769767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.769734    5054 generic.go:356] "Generic (PLEG): container finished" podID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" containerID="b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de" exitCode=0
Nov 02 17:46:33.770240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.769775    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-876zg"
Nov 02 17:46:33.770240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.769818    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" event={"ID":"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b","Type":"ContainerDied","Data":"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"}
Nov 02 17:46:33.770240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.769891    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-876zg" event={"ID":"7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b","Type":"ContainerDied","Data":"df9c488238c06588bd851f9b4607262c93b24fe4637d719816afe9a18b9391bd"}
Nov 02 17:46:33.770240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.769920    5054 scope.go:122] "RemoveContainer" containerID="b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"
Nov 02 17:46:33.795554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.795525    5054 generic.go:356] "Generic (PLEG): container finished" podID="a5d4909e-5552-46c8-adcc-9087c5598dfc" containerID="bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc" exitCode=0
Nov 02 17:46:33.795705 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.795580    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-s46z9"
Nov 02 17:46:33.795705 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.795601    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" event={"ID":"a5d4909e-5552-46c8-adcc-9087c5598dfc","Type":"ContainerDied","Data":"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"}
Nov 02 17:46:33.795705 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.795646    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-s46z9" event={"ID":"a5d4909e-5552-46c8-adcc-9087c5598dfc","Type":"ContainerDied","Data":"927e384fbaec8b7cbcd3100ac69022f4241460db424afb17caac19b0443c759c"}
Nov 02 17:46:33.808338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.808320    5054 scope.go:122] "RemoveContainer" containerID="b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"
Nov 02 17:46:33.808652 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:46:33.808633    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de\": container with ID starting with b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de not found: ID does not exist" containerID="b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"
Nov 02 17:46:33.808735 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.808662    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de"} err="failed to get container status \"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de\": rpc error: code = NotFound desc = could not find container \"b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de\": container with ID starting with b67adbab387f69de56558b5a5933ed3688f31f9a33668f188a351ea5e43691de not found: ID does not exist"
Nov 02 17:46:33.808735 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.808678    5054 scope.go:122] "RemoveContainer" containerID="bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"
Nov 02 17:46:33.816894 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.816876    5054 scope.go:122] "RemoveContainer" containerID="bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"
Nov 02 17:46:33.817172 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:46:33.817151    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc\": container with ID starting with bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc not found: ID does not exist" containerID="bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"
Nov 02 17:46:33.817252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.817179    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc"} err="failed to get container status \"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc\": rpc error: code = NotFound desc = could not find container \"bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc\": container with ID starting with bed2844bbfac84ceb60bd2cb6ba3af12b5ae312c3363ef0f1c57068dcdfb05fc not found: ID does not exist"
Nov 02 17:46:33.819779 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.819750    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:46:33.822126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.822107    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-876zg"]
Nov 02 17:46:33.832980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.832958    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:33.834772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:33.834744    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-s46z9"]
Nov 02 17:46:34.303067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:34.303031    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 02 17:46:34.303242 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:34.303087    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 02 17:46:34.615368 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:34.615294    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" path="/var/lib/kubelet/pods/7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b/volumes"
Nov 02 17:46:34.615662 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:34.615647    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5d4909e-5552-46c8-adcc-9087c5598dfc" path="/var/lib/kubelet/pods/a5d4909e-5552-46c8-adcc-9087c5598dfc/volumes"
Nov 02 17:46:35.303007 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:35.302964    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 02 17:46:35.303419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:35.303043    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 02 17:46:36.307111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:36.307082    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:46:36.307526 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:36.307360    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:46:36.308106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:36.308088    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq"
Nov 02 17:46:40.641651 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:40.641577    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:40.642073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:40.641785    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" podUID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" containerName="maas-api" containerID="cri-o://f6f3832ad627e23e9acb0d85c591c2e5916371a6889eaefe7fb57d47a451d956" gracePeriod=30
Nov 02 17:46:40.838477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:40.838442    5054 generic.go:356] "Generic (PLEG): container finished" podID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" containerID="f6f3832ad627e23e9acb0d85c591c2e5916371a6889eaefe7fb57d47a451d956" exitCode=0
Nov 02 17:46:40.838619 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:40.838507    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" event={"ID":"b7f0d404-ee75-4452-88ee-8ad3d43812d9","Type":"ContainerDied","Data":"f6f3832ad627e23e9acb0d85c591c2e5916371a6889eaefe7fb57d47a451d956"}
Nov 02 17:46:40.892058 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:40.891996    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:41.059542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.059513    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\") pod \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") "
Nov 02 17:46:41.059682 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.059562    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\") pod \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") "
Nov 02 17:46:41.059682 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.059587    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\") pod \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") "
Nov 02 17:46:41.059682 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.059635    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\" (UniqueName: \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\") pod \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\" (UID: \"b7f0d404-ee75-4452-88ee-8ad3d43812d9\") "
Nov 02 17:46:41.060027 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.060000    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca" pod "b7f0d404-ee75-4452-88ee-8ad3d43812d9" (UID: "b7f0d404-ee75-4452-88ee-8ad3d43812d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:46:41.061740 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.061707    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls" pod "b7f0d404-ee75-4452-88ee-8ad3d43812d9" (UID: "b7f0d404-ee75-4452-88ee-8ad3d43812d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:46:41.061871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.061801    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs" pod "b7f0d404-ee75-4452-88ee-8ad3d43812d9" (UID: "b7f0d404-ee75-4452-88ee-8ad3d43812d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:46:41.061871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.061825    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9" pod "b7f0d404-ee75-4452-88ee-8ad3d43812d9" (UID: "b7f0d404-ee75-4452-88ee-8ad3d43812d9"). InnerVolumeSpecName "kube-api-access-mszj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:46:41.160288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.160229    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:41.160288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.160253    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f0d404-ee75-4452-88ee-8ad3d43812d9-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:41.160288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.160263    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mszj9\" (UniqueName: \"kubernetes.io/projected/b7f0d404-ee75-4452-88ee-8ad3d43812d9-kube-api-access-mszj9\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:41.160288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.160275    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f0d404-ee75-4452-88ee-8ad3d43812d9-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:46:41.844352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.844321    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"
Nov 02 17:46:41.844352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.844339    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx" event={"ID":"b7f0d404-ee75-4452-88ee-8ad3d43812d9","Type":"ContainerDied","Data":"c8695672bded89dc95baf9b766a84e54fef7765e542fd82eb65c69a44f5fc2cb"}
Nov 02 17:46:41.844820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.844401    5054 scope.go:122] "RemoveContainer" containerID="f6f3832ad627e23e9acb0d85c591c2e5916371a6889eaefe7fb57d47a451d956"
Nov 02 17:46:41.867800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.867772    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:41.872380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:41.872355    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-5w6bx"]
Nov 02 17:46:42.615514 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:46:42.615479    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" path="/var/lib/kubelet/pods/b7f0d404-ee75-4452-88ee-8ad3d43812d9/volumes"
Nov 02 17:46:45.834264 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:46:45.834228    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:47:15.834689 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:47:15.834652    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:47:28.026339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026294    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"]
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026765    5054 cpu_manager.go:414] "containerMap: removing container" podUID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" containerName="maas-api"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026782    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" containerName="maas-api"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026822    5054 cpu_manager.go:414] "containerMap: removing container" podUID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" containerName="authorino"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026828    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" containerName="authorino"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026855    5054 cpu_manager.go:414] "containerMap: removing container" podUID="a5d4909e-5552-46c8-adcc-9087c5598dfc" containerName="authorino"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026861    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5d4909e-5552-46c8-adcc-9087c5598dfc" containerName="authorino"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026916    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5d4909e-5552-46c8-adcc-9087c5598dfc" containerName="authorino"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026924    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7f0d404-ee75-4452-88ee-8ad3d43812d9" containerName="maas-api"
Nov 02 17:47:28.026998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.026934    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f42deaa-7979-4ad8-b8d4-a368d4d7ba5b" containerName="authorino"
Nov 02 17:47:28.030205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.030178    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.037474 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.037090    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 02 17:47:28.037474 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.037087    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-59qm5\""
Nov 02 17:47:28.039601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.039577    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 02 17:47:28.040265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.040244    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"]
Nov 02 17:47:28.137030 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.136992    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Nov 02 17:47:28.167114 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167072    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.167286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167137    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.167286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167240    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.167286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167270    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.167401 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167290    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrhmn\" (UniqueName: \"kubernetes.io/projected/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-kube-api-access-hrhmn\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.167446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.167410    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268160    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268259    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268306    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268330    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268354    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrhmn\" (UniqueName: \"kubernetes.io/projected/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-kube-api-access-hrhmn\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268402    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268663 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268637    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268692    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.268949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.268930    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.270930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.270906    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.271931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.271906    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.278511 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.278456    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrhmn\" (UniqueName: \"kubernetes.io/projected/0f42dd65-fbba-4ff0-91ee-b306f06d5cad-kube-api-access-hrhmn\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4\" (UID: \"0f42dd65-fbba-4ff0-91ee-b306f06d5cad\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.342717 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.342681    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:28.552173 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.552085    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:47:28.630024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:28.628222    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"]
Nov 02 17:47:28.635807 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:47:28.635773    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f42dd65_fbba_4ff0_91ee_b306f06d5cad.slice/crio-b0b206e64fb0976c1763aad86a49662b8818ac829c9ab2ea2e7d3f483904b45c WatchSource:0}: Error finding container b0b206e64fb0976c1763aad86a49662b8818ac829c9ab2ea2e7d3f483904b45c: Status 404 returned error can't find the container with id b0b206e64fb0976c1763aad86a49662b8818ac829c9ab2ea2e7d3f483904b45c
Nov 02 17:47:29.095807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:29.095770    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" event={"ID":"0f42dd65-fbba-4ff0-91ee-b306f06d5cad","Type":"ContainerStarted","Data":"b0b206e64fb0976c1763aad86a49662b8818ac829c9ab2ea2e7d3f483904b45c"}
Nov 02 17:47:30.161544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.161513    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"]
Nov 02 17:47:30.166991 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.166967    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.172427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.172401    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 02 17:47:30.175864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.175818    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"]
Nov 02 17:47:30.288262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288230    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.288262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288264    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.288521 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288497    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.288575 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288542    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5czkb\" (UniqueName: \"kubernetes.io/projected/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-kube-api-access-5czkb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.288620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288604    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.288664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.288631    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.389760 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389675    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.389760 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389715    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5czkb\" (UniqueName: \"kubernetes.io/projected/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-kube-api-access-5czkb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.389760 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389736    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389875    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389941    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.389958    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390207 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.390186    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390301 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.390282    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.390351 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.390318    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.392160 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.392132    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.392395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.392378    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.398562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.398534    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5czkb\" (UniqueName: \"kubernetes.io/projected/02cb255a-a7fa-4b5f-9564-4cf7b31f241b-kube-api-access-5czkb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc\" (UID: \"02cb255a-a7fa-4b5f-9564-4cf7b31f241b\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.487190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.487156    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:30.765395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.765366    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"]
Nov 02 17:47:30.767452 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:47:30.767422    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cb255a_a7fa_4b5f_9564_4cf7b31f241b.slice/crio-30b20f487c942fa57e2a585e4bcbb881d83d9b04b3670e6ca097d1ed03eb8121 WatchSource:0}: Error finding container 30b20f487c942fa57e2a585e4bcbb881d83d9b04b3670e6ca097d1ed03eb8121: Status 404 returned error can't find the container with id 30b20f487c942fa57e2a585e4bcbb881d83d9b04b3670e6ca097d1ed03eb8121
Nov 02 17:47:30.778561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:30.778528    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:47:31.110001 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:31.109967    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" event={"ID":"0f42dd65-fbba-4ff0-91ee-b306f06d5cad","Type":"ContainerStarted","Data":"d75f2bdc527d170b764f7994d886c8faa708ef7d4a6d12a62d1d56be9562e0d9"}
Nov 02 17:47:31.111298 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:31.111273    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc" event={"ID":"02cb255a-a7fa-4b5f-9564-4cf7b31f241b","Type":"ContainerStarted","Data":"30b20f487c942fa57e2a585e4bcbb881d83d9b04b3670e6ca097d1ed03eb8121"}
Nov 02 17:47:31.128643 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:31.128591    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podStartSLOduration=1.633696909 podStartE2EDuration="3.128576669s" totalImagesPullingTime="1.49487976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:47:31.128474343 +0000 UTC m=+454.637236412" watchObservedRunningTime="2026-11-02 17:47:31.128576669 +0000 UTC m=+454.637338737"
Nov 02 17:47:31.343368 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:31.343332    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:32.118310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:32.118272    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc" event={"ID":"02cb255a-a7fa-4b5f-9564-4cf7b31f241b","Type":"ContainerStarted","Data":"90da77d28ca7f3767041e45d887c3d9bbda8b8874156674f274613cafd65fa02"}
Nov 02 17:47:32.136620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:32.136566    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc" podStartSLOduration=1.803548647 podStartE2EDuration="2.13655149s" totalImagesPullingTime="333.002843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:47:32.134724196 +0000 UTC m=+455.643486265" watchObservedRunningTime="2026-11-02 17:47:32.13655149 +0000 UTC m=+455.645313594"
Nov 02 17:47:32.487518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:32.487482    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:33.075862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:33.075493    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:47:35.055859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.055688    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"]
Nov 02 17:47:35.064933 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.061472    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.070726 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.070694    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"]
Nov 02 17:47:35.072535 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.072512    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 02 17:47:35.245133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245097    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.245133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245135    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.245348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245154    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbl2\" (UniqueName: \"kubernetes.io/projected/92e662d8-2058-4913-b42e-79039cb95b49-kube-api-access-pmbl2\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.245348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245222    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e662d8-2058-4913-b42e-79039cb95b49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.245348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245291    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.245449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.245369    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346131 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346043    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346131 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346090    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346131 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346114    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346409 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346137    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbl2\" (UniqueName: \"kubernetes.io/projected/92e662d8-2058-4913-b42e-79039cb95b49-kube-api-access-pmbl2\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346409 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346272    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e662d8-2058-4913-b42e-79039cb95b49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346409 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346350    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346525    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346650 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346627    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.346762 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.346736    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.348593 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.348567    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e662d8-2058-4913-b42e-79039cb95b49-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.349031 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.349010    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e662d8-2058-4913-b42e-79039cb95b49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.354553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.354520    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbl2\" (UniqueName: \"kubernetes.io/projected/92e662d8-2058-4913-b42e-79039cb95b49-kube-api-access-pmbl2\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-659wp\" (UID: \"92e662d8-2058-4913-b42e-79039cb95b49\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.386955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.386915    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:35.676934 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:35.676904    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"]
Nov 02 17:47:35.677693 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:47:35.677656    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e662d8_2058_4913_b42e_79039cb95b49.slice/crio-1aba8c190138fe1fbd9af914d30d01f8bea8803968022e84ea6fe85a0f6f61ba WatchSource:0}: Error finding container 1aba8c190138fe1fbd9af914d30d01f8bea8803968022e84ea6fe85a0f6f61ba: Status 404 returned error can't find the container with id 1aba8c190138fe1fbd9af914d30d01f8bea8803968022e84ea6fe85a0f6f61ba
Nov 02 17:47:36.047614 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:36.047571    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:47:36.150145 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:36.150104    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp" event={"ID":"92e662d8-2058-4913-b42e-79039cb95b49","Type":"ContainerStarted","Data":"a28c5d9cdfda81cae44a27be37294983d78fc5b23c3605a7fb85f4cb5754ec56"}
Nov 02 17:47:36.150633 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:36.150173    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp" event={"ID":"92e662d8-2058-4913-b42e-79039cb95b49","Type":"ContainerStarted","Data":"1aba8c190138fe1fbd9af914d30d01f8bea8803968022e84ea6fe85a0f6f61ba"}
Nov 02 17:47:36.178872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:36.178784    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp" podStartSLOduration=0.847372654 podStartE2EDuration="1.178769463s" totalImagesPullingTime="331.396809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:47:36.176383878 +0000 UTC m=+459.685145946" watchObservedRunningTime="2026-11-02 17:47:36.178769463 +0000 UTC m=+459.687531530"
Nov 02 17:47:36.389093 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:36.388927    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:38.343388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.343356    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:38.357380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.357342    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:38.714860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.714544    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"]
Nov 02 17:47:38.753859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.750987    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"]
Nov 02 17:47:38.753859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.751112    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.761130 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.760935    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 02 17:47:38.885235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885192    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125c00ca-770b-45d4-be0b-1cbb03868581-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.885432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885251    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.885432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885365    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.885432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885395    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxpc\" (UniqueName: \"kubernetes.io/projected/125c00ca-770b-45d4-be0b-1cbb03868581-kube-api-access-jcxpc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.885432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885429    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.885712 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.885521    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987079 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.986981    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987079 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987047    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987088    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125c00ca-770b-45d4-be0b-1cbb03868581-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987148    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987194    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987222    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxpc\" (UniqueName: \"kubernetes.io/projected/125c00ca-770b-45d4-be0b-1cbb03868581-kube-api-access-jcxpc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987551 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987433    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987613 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987563    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.987785 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.987757    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.989980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.989959    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125c00ca-770b-45d4-be0b-1cbb03868581-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:38.990349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:38.990307    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125c00ca-770b-45d4-be0b-1cbb03868581-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:39.001621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:39.001578    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxpc\" (UniqueName: \"kubernetes.io/projected/125c00ca-770b-45d4-be0b-1cbb03868581-kube-api-access-jcxpc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh\" (UID: \"125c00ca-770b-45d4-be0b-1cbb03868581\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:39.082627 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:39.082581    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:39.186818 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:39.186687    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:47:39.365085 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:39.365055    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"]
Nov 02 17:47:39.367806 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:47:39.367772    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125c00ca_770b_45d4_be0b_1cbb03868581.slice/crio-e326e5458824c43595cba1dcce274233650b1e771ca6961d00d3a7858c33784a WatchSource:0}: Error finding container e326e5458824c43595cba1dcce274233650b1e771ca6961d00d3a7858c33784a: Status 404 returned error can't find the container with id e326e5458824c43595cba1dcce274233650b1e771ca6961d00d3a7858c33784a
Nov 02 17:47:40.180097 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.180031    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh" event={"ID":"125c00ca-770b-45d4-be0b-1cbb03868581","Type":"ContainerStarted","Data":"91a3f3c7ac7c5e3403a6b6e5da4707ccd380bae0054f596f4440864b15dbf942"}
Nov 02 17:47:40.180502 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.180473    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh" event={"ID":"125c00ca-770b-45d4-be0b-1cbb03868581","Type":"ContainerStarted","Data":"e326e5458824c43595cba1dcce274233650b1e771ca6961d00d3a7858c33784a"}
Nov 02 17:47:40.488268 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.487954    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:40.501741 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.501712    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:40.520415 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.520345    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh" podStartSLOduration=2.208610632 podStartE2EDuration="2.520327006s" totalImagesPullingTime="311.716374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:47:40.201040429 +0000 UTC m=+463.709802501" watchObservedRunningTime="2026-11-02 17:47:40.520327006 +0000 UTC m=+464.029089076"
Nov 02 17:47:40.769957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:40.769869    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:47:41.083124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:41.083025    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:41.201618 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:41.201584    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc"
Nov 02 17:47:45.387585 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:45.387544    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:45.399925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:45.399900    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:45.835590 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:47:45.835557    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:47:46.238946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:46.238915    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp"
Nov 02 17:47:49.083174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:49.083142    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:49.095690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:49.095661    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:49.254728 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:49.254700    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh"
Nov 02 17:47:51.860386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:51.860354    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d88f6c9-btwtv"]
Nov 02 17:47:51.864332 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:51.864312    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:51.873321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:51.873296    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d88f6c9-btwtv"]
Nov 02 17:47:51.909254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:51.909216    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z67dx\" (UniqueName: \"kubernetes.io/projected/1dfccd22-f886-435b-a52e-b389d887bf0a-kube-api-access-z67dx\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:51.909254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:51.909255    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dfccd22-f886-435b-a52e-b389d887bf0a-tls-cert\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.010235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.010177    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z67dx\" (UniqueName: \"kubernetes.io/projected/1dfccd22-f886-435b-a52e-b389d887bf0a-kube-api-access-z67dx\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.010235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.010236    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dfccd22-f886-435b-a52e-b389d887bf0a-tls-cert\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.012922 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.012890    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dfccd22-f886-435b-a52e-b389d887bf0a-tls-cert\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.020312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.020252    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z67dx\" (UniqueName: \"kubernetes.io/projected/1dfccd22-f886-435b-a52e-b389d887bf0a-kube-api-access-z67dx\") pod \"authorino-75d88f6c9-btwtv\" (UID: \"1dfccd22-f886-435b-a52e-b389d887bf0a\") " pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.178937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.178899    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d88f6c9-btwtv"
Nov 02 17:47:52.454615 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:52.454588    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d88f6c9-btwtv"]
Nov 02 17:47:52.456073 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:47:52.456045    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dfccd22_f886_435b_a52e_b389d887bf0a.slice/crio-45af8a1668021e4f01e2a2be62890e67d9dc5e4b2bbcf95207fc0e22359212d6 WatchSource:0}: Error finding container 45af8a1668021e4f01e2a2be62890e67d9dc5e4b2bbcf95207fc0e22359212d6: Status 404 returned error can't find the container with id 45af8a1668021e4f01e2a2be62890e67d9dc5e4b2bbcf95207fc0e22359212d6
Nov 02 17:47:53.267237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:53.267199    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d88f6c9-btwtv" event={"ID":"1dfccd22-f886-435b-a52e-b389d887bf0a","Type":"ContainerStarted","Data":"45af8a1668021e4f01e2a2be62890e67d9dc5e4b2bbcf95207fc0e22359212d6"}
Nov 02 17:47:54.277968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.277926    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d88f6c9-btwtv" event={"ID":"1dfccd22-f886-435b-a52e-b389d887bf0a","Type":"ContainerStarted","Data":"06e0648d408a0f7856aa92ad0a83ee104fd036f3d73b3300a519be2a70b194bd"}
Nov 02 17:47:54.295862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.295779    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-75d88f6c9-btwtv" podStartSLOduration=2.428007574 podStartE2EDuration="3.295762415s" totalImagesPullingTime="867.754841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:47:54.294751579 +0000 UTC m=+477.803513647" watchObservedRunningTime="2026-11-02 17:47:54.295762415 +0000 UTC m=+477.804524474"
Nov 02 17:47:54.340893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.332500    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:47:54.340893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.332959    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-54c89778b8-mqnwb" podUID="860b5d22-a09a-4159-8b69-312bd4ed835f" containerName="authorino" containerID="cri-o://911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319" gracePeriod=30
Nov 02 17:47:54.637051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.637025    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:47:54.737995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.737960    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\" (UniqueName: \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\") pod \"860b5d22-a09a-4159-8b69-312bd4ed835f\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") "
Nov 02 17:47:54.738165 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.738030    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\" (UniqueName: \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\") pod \"860b5d22-a09a-4159-8b69-312bd4ed835f\" (UID: \"860b5d22-a09a-4159-8b69-312bd4ed835f\") "
Nov 02 17:47:54.740174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.740143    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p" pod "860b5d22-a09a-4159-8b69-312bd4ed835f" (UID: "860b5d22-a09a-4159-8b69-312bd4ed835f"). InnerVolumeSpecName "kube-api-access-pkk7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:47:54.752775 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.752738    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert" pod "860b5d22-a09a-4159-8b69-312bd4ed835f" (UID: "860b5d22-a09a-4159-8b69-312bd4ed835f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:47:54.838975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.838936    5054 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/860b5d22-a09a-4159-8b69-312bd4ed835f-tls-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:47:54.838975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:54.838975    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkk7p\" (UniqueName: \"kubernetes.io/projected/860b5d22-a09a-4159-8b69-312bd4ed835f-kube-api-access-pkk7p\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:47:55.285667 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.285629    5054 generic.go:356] "Generic (PLEG): container finished" podID="860b5d22-a09a-4159-8b69-312bd4ed835f" containerID="911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319" exitCode=0
Nov 02 17:47:55.285667 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.285678    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c89778b8-mqnwb"
Nov 02 17:47:55.286279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.285713    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c89778b8-mqnwb" event={"ID":"860b5d22-a09a-4159-8b69-312bd4ed835f","Type":"ContainerDied","Data":"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"}
Nov 02 17:47:55.286279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.285762    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c89778b8-mqnwb" event={"ID":"860b5d22-a09a-4159-8b69-312bd4ed835f","Type":"ContainerDied","Data":"1e5627a65d721808fe8214c84e9cc11598bd993f1c89189d2382bbc8306f0f70"}
Nov 02 17:47:55.286279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.285783    5054 scope.go:122] "RemoveContainer" containerID="911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"
Nov 02 17:47:55.296000 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.295977    5054 scope.go:122] "RemoveContainer" containerID="911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"
Nov 02 17:47:55.296267 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:47:55.296249    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319\": container with ID starting with 911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319 not found: ID does not exist" containerID="911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"
Nov 02 17:47:55.296316 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.296277    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319"} err="failed to get container status \"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319\": rpc error: code = NotFound desc = could not find container \"911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319\": container with ID starting with 911289c1adb63928cb2ff9e4a393f30ec1a1ea61c24087448bc8d91f60b0f319 not found: ID does not exist"
Nov 02 17:47:55.309560 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.309533    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:47:55.312880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:55.312853    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54c89778b8-mqnwb"]
Nov 02 17:47:56.616884 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:47:56.616832    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="860b5d22-a09a-4159-8b69-312bd4ed835f" path="/var/lib/kubelet/pods/860b5d22-a09a-4159-8b69-312bd4ed835f/volumes"
Nov 02 17:48:01.320091 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.320053    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"]
Nov 02 17:48:01.320772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.320751    5054 cpu_manager.go:414] "containerMap: removing container" podUID="860b5d22-a09a-4159-8b69-312bd4ed835f" containerName="authorino"
Nov 02 17:48:01.320772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.320772    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="860b5d22-a09a-4159-8b69-312bd4ed835f" containerName="authorino"
Nov 02 17:48:01.320931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.320896    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="860b5d22-a09a-4159-8b69-312bd4ed835f" containerName="authorino"
Nov 02 17:48:01.325919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.325904    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.336637 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.336612    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"]
Nov 02 17:48:01.336926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.336903    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Nov 02 17:48:01.353852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.353797    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"]
Nov 02 17:48:01.357961 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.357939    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.373151 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.373115    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"]
Nov 02 17:48:01.401046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401013    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"]
Nov 02 17:48:01.401408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401385    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401482 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401429    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78aa813-24d6-4641-8b94-f1f190f2a381-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.401542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401497    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401576    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401645 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401633    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401696 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401677    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjkj\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-kube-api-access-7bjkj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401753 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401734    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbqt\" (UniqueName: \"kubernetes.io/projected/c78aa813-24d6-4641-8b94-f1f190f2a381-kube-api-access-dxbqt\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.401872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401851    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401895    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401913    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.401987 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.401934    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.404973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.404958    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.421941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.421908    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"]
Nov 02 17:48:01.450729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.450696    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9vxcg\""
Nov 02 17:48:01.503109 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503072    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503116    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb03fd59-1903-4e96-a3cf-2102886150c4-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.503289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503148    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjkj\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-kube-api-access-7bjkj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503169    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbqt\" (UniqueName: \"kubernetes.io/projected/c78aa813-24d6-4641-8b94-f1f190f2a381-kube-api-access-dxbqt\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.503289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503201    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503233    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503343    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503397    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78aa813-24d6-4641-8b94-f1f190f2a381-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.503506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503428    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503462    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nt2\" (UniqueName: \"kubernetes.io/projected/bb03fd59-1903-4e96-a3cf-2102886150c4-kube-api-access-p7nt2\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.503506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503499    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503515    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503559    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503587    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503794    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.503978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.503921    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.504085 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.504064    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.504353 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.504331    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.504520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.504502    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78aa813-24d6-4641-8b94-f1f190f2a381-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.506426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.506405    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.506545 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.506528    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.511858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.511817    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.512243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.512224    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjkj\" (UniqueName: \"kubernetes.io/projected/39c672d2-c80e-4b1a-bfa9-70827effa6ae-kube-api-access-7bjkj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-qgrwq\" (UID: \"39c672d2-c80e-4b1a-bfa9-70827effa6ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.512549 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.512533    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbqt\" (UniqueName: \"kubernetes.io/projected/c78aa813-24d6-4641-8b94-f1f190f2a381-kube-api-access-dxbqt\") pod \"payload-pre-processing-7b98bb678c-z2mhf\" (UID: \"c78aa813-24d6-4641-8b94-f1f190f2a381\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.604812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.604724    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb03fd59-1903-4e96-a3cf-2102886150c4-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.604812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.604789    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nt2\" (UniqueName: \"kubernetes.io/projected/bb03fd59-1903-4e96-a3cf-2102886150c4-kube-api-access-p7nt2\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.605518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.605492    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb03fd59-1903-4e96-a3cf-2102886150c4-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.612649 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.612620    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nt2\" (UniqueName: \"kubernetes.io/projected/bb03fd59-1903-4e96-a3cf-2102886150c4-kube-api-access-p7nt2\") pod \"payload-processing-55fbbbf9dc-9nt6k\" (UID: \"bb03fd59-1903-4e96-a3cf-2102886150c4\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.640477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.640450    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:01.672974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.672942    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:01.720491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.720357    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:01.916494 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.916442    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"]
Nov 02 17:48:01.917778 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:48:01.917745    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78aa813_24d6_4641_8b94_f1f190f2a381.slice/crio-64697093da3d00dbd6846554e407cc9df3fdcdc77bf742aa400db99ba4c442ea WatchSource:0}: Error finding container 64697093da3d00dbd6846554e407cc9df3fdcdc77bf742aa400db99ba4c442ea: Status 404 returned error can't find the container with id 64697093da3d00dbd6846554e407cc9df3fdcdc77bf742aa400db99ba4c442ea
Nov 02 17:48:01.956622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.956596    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"]
Nov 02 17:48:01.957716 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:48:01.957689    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c672d2_c80e_4b1a_bfa9_70827effa6ae.slice/crio-0b1182abf60fd9d0f12e29bb576000d7520807279bf037da827b1889cf8e3c6f WatchSource:0}: Error finding container 0b1182abf60fd9d0f12e29bb576000d7520807279bf037da827b1889cf8e3c6f: Status 404 returned error can't find the container with id 0b1182abf60fd9d0f12e29bb576000d7520807279bf037da827b1889cf8e3c6f
Nov 02 17:48:01.960016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.959983    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:01.960103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.960051    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:01.960103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:01.960081    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:02.008558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.008531    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"]
Nov 02 17:48:02.010081 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:48:02.010052    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb03fd59_1903_4e96_a3cf_2102886150c4.slice/crio-e89eaa76ba984a3241048c575fa08708038e603f065366f8b7e9d24f509deda3 WatchSource:0}: Error finding container e89eaa76ba984a3241048c575fa08708038e603f065366f8b7e9d24f509deda3: Status 404 returned error can't find the container with id e89eaa76ba984a3241048c575fa08708038e603f065366f8b7e9d24f509deda3
Nov 02 17:48:02.328515 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.328409    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" event={"ID":"39c672d2-c80e-4b1a-bfa9-70827effa6ae","Type":"ContainerStarted","Data":"bd6739a2ba1aac5b243cb39672d2ce580e41a915a294e5ff453420a2c3036da2"}
Nov 02 17:48:02.328515 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.328482    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" event={"ID":"39c672d2-c80e-4b1a-bfa9-70827effa6ae","Type":"ContainerStarted","Data":"0b1182abf60fd9d0f12e29bb576000d7520807279bf037da827b1889cf8e3c6f"}
Nov 02 17:48:02.329823 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.329793    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf" event={"ID":"c78aa813-24d6-4641-8b94-f1f190f2a381","Type":"ContainerStarted","Data":"64697093da3d00dbd6846554e407cc9df3fdcdc77bf742aa400db99ba4c442ea"}
Nov 02 17:48:02.331134 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.331105    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k" event={"ID":"bb03fd59-1903-4e96-a3cf-2102886150c4","Type":"ContainerStarted","Data":"e89eaa76ba984a3241048c575fa08708038e603f065366f8b7e9d24f509deda3"}
Nov 02 17:48:02.348420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.348367    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podStartSLOduration=1.348353398 podStartE2EDuration="1.348353398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:48:02.346171214 +0000 UTC m=+485.854933281" watchObservedRunningTime="2026-11-02 17:48:02.348353398 +0000 UTC m=+485.857115462"
Nov 02 17:48:02.698474 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:02.698439    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:03.696518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:03.696403    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:03.696518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:03.696491    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:04.692787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:04.692307    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:04.692787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:04.692376    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:05.352773 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.352689    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf" event={"ID":"c78aa813-24d6-4641-8b94-f1f190f2a381","Type":"ContainerStarted","Data":"e8550769f8c7c32d5a55e62e42ca36434979f4b86a53a115299258885fc31d7b"}
Nov 02 17:48:05.353240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.352801    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:05.354396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.354376    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k" event={"ID":"bb03fd59-1903-4e96-a3cf-2102886150c4","Type":"ContainerStarted","Data":"5fa649c28d0c09a39be65f9d4d97e19986fa5882b1fc1d81ee61370a9c092f78"}
Nov 02 17:48:05.354471 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.354428    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:05.394870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.392997    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf" podStartSLOduration=1.285737806 podStartE2EDuration="4.392978933s" totalImagesPullingTime="3.107241127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:48:05.36888914 +0000 UTC m=+488.877651209" watchObservedRunningTime="2026-11-02 17:48:05.392978933 +0000 UTC m=+488.901741001"
Nov 02 17:48:05.397908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.397861    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k" podStartSLOduration=1.45138419 podStartE2EDuration="4.39784964s" totalImagesPullingTime="2.94646545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:48:05.395432939 +0000 UTC m=+488.904195009" watchObservedRunningTime="2026-11-02 17:48:05.39784964 +0000 UTC m=+488.906611698"
Nov 02 17:48:05.690862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.684237    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:05.690862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:05.684297    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:06.687864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:06.686239    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:06.687864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:06.686300    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:07.678921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:07.675240    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:07.678921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:07.675308    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:08.673653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:08.673618    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 02 17:48:08.674061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:08.673675    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 02 17:48:10.198579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:10.198539    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:10.199097 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:10.199055    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:10.199956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:10.199936    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq"
Nov 02 17:48:15.834781 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:48:15.834742    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:48:16.362373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.362341    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z2mhf"
Nov 02 17:48:16.362648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.362627    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-9nt6k"
Nov 02 17:48:16.393864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.393813    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"]
Nov 02 17:48:16.398285 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.398262    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.423806 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.423775    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"]
Nov 02 17:48:16.554349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554305    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554405    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554465    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554496    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554679 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554556    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554679 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554634    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554747    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554868    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhl9b\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-kube-api-access-dhl9b\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.554969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.554913    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5804f291-3559-4dda-9b22-ecbf6b2466fd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656119    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656151    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656205 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656175    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656291    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656329    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656360    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656408    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656514    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhl9b\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-kube-api-access-dhl9b\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656563    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5804f291-3559-4dda-9b22-ecbf6b2466fd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656625    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656564    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.656833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656680    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.657094 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.656999    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.657300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.657278    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5804f291-3559-4dda-9b22-ecbf6b2466fd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.658886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.658855    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.658980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.658904    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.665033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.665012    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhl9b\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-kube-api-access-dhl9b\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.665118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.665014    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5804f291-3559-4dda-9b22-ecbf6b2466fd-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-2m464\" (UID: \"5804f291-3559-4dda-9b22-ecbf6b2466fd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:16.715307 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:16.715280    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:17.017792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.017765    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"]
Nov 02 17:48:17.019220 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:48:17.019193    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5804f291_3559_4dda_9b22_ecbf6b2466fd.slice/crio-d82e56d006e2af1062b7f988033bd2b43cea8aa1d55ea3a3b50c01c78ef51af9 WatchSource:0}: Error finding container d82e56d006e2af1062b7f988033bd2b43cea8aa1d55ea3a3b50c01c78ef51af9: Status 404 returned error can't find the container with id d82e56d006e2af1062b7f988033bd2b43cea8aa1d55ea3a3b50c01c78ef51af9
Nov 02 17:48:17.021425 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.021392    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:17.021537 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.021456    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:17.021537 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.021490    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:48:17.428341 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.428303    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" event={"ID":"5804f291-3559-4dda-9b22-ecbf6b2466fd","Type":"ContainerStarted","Data":"88a46c89d9644a933f31c40d6e8d79d780060339d67faab922d6d849893bb613"}
Nov 02 17:48:17.428341 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.428361    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" event={"ID":"5804f291-3559-4dda-9b22-ecbf6b2466fd","Type":"ContainerStarted","Data":"d82e56d006e2af1062b7f988033bd2b43cea8aa1d55ea3a3b50c01c78ef51af9"}
Nov 02 17:48:17.465254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.465203    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podStartSLOduration=1.465190791 podStartE2EDuration="1.465190791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:48:17.463963572 +0000 UTC m=+500.972725638" watchObservedRunningTime="2026-11-02 17:48:17.465190791 +0000 UTC m=+500.973952859"
Nov 02 17:48:17.715420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:17.715338    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:18.717588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:18.717550    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:18.718020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:18.717606    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:19.716463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:19.716424    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:19.716640 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:19.716476    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:20.716142 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:20.716106    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:20.716552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:20.716164    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:21.715954 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:21.715916    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:21.716129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:21.715970    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:22.716593 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:22.716555    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:22.717012 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:22.716620    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:23.716498 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:23.716461    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 02 17:48:23.716710 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:23.716526    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 02 17:48:25.219652 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:25.219620    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:25.220969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:25.220933    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:25.221677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:48:25.221651    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464"
Nov 02 17:48:45.835035 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:48:45.834995    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:49:06.558462 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.558425    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:49:06.564007 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.563984    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.572675 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.572648    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f37d16-openshift-default-dockercfg-5tcm2\""
Nov 02 17:49:06.577005 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.576977    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:49:06.660023 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.659985    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660222 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660041    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660222 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660199    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660248    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660282    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlv7g\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660334    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660365    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660416    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.660581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.660450    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761036    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761079    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761131    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761154    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761190    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761211    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761232    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlv7g\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761257    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761275    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761674    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761777 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761721    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.761966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.761923    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.762126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.762104    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.762126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.762043    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.763993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.763969    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.764216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.764179    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.781161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.781130    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlv7g\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.795215 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.795188    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.880379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.880296    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:06.890905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.890879    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 17:49:06.895173 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.895151    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.910874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.910823    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-bb4ecb-openshift-default-dockercfg-j9575\""
Nov 02 17:49:06.914127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.914099    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963456    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdz7w\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963527    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963589    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963645    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963731    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963930    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.963979    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.964023    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:06.966877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:06.964057    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.038024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.037992    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:49:07.041769 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.041751    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.049306 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.049288    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2a295c-openshift-default-dockercfg-kqbfr\""
Nov 02 17:49:07.065454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065410    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.065454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065481    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065563    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065596    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065655    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdz7w\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065679    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065702    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065741    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065792    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065852    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.065901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065891    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgps\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.066305 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.065940    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.066305 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066205    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.066305 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066287    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.066463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066335    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.066463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066374    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.066463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066403    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.066463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066452    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.066812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.066777    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:49:07.068573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.067402    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.068573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.067413    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.068573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.067652    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.068573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.067912    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.068573 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.068384    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.069571 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.069551    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.070014 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.069994    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.088784 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.088731    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.089150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.089127    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdz7w\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.167406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167367    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167416    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167469    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167503    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgps\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167551    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167630    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.167826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167731    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.167828    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.168307    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168513 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.168397    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168513 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.168455    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168723 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.168694    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.168919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.168881    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.169318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.169294    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.170397 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.170375    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.170706 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.170680    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.182490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.182462    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.182600 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.182585    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgps\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.201092 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.201067    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:49:07.202504 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:07.202480    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ac0470_6653_4011_ade7_6539315c395b.slice/crio-f52e35d6f76aa3611df60c9e80069921b181cde924638585654bcbaa43a2ca1e WatchSource:0}: Error finding container f52e35d6f76aa3611df60c9e80069921b181cde924638585654bcbaa43a2ca1e: Status 404 returned error can't find the container with id f52e35d6f76aa3611df60c9e80069921b181cde924638585654bcbaa43a2ca1e
Nov 02 17:49:07.204742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.204710    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.204833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.204774    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.204833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.204800    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.232095 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.232069    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:07.355241 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.355210    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:07.574897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.574870    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 17:49:07.577408 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:07.577378    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b9eacd_5bc8_4e2b_b1f2_0c11b4e3ef1c.slice/crio-df340528fc143c897af387e2e5f7a552366d62a7dba66bffe01901d1116f0f34 WatchSource:0}: Error finding container df340528fc143c897af387e2e5f7a552366d62a7dba66bffe01901d1116f0f34: Status 404 returned error can't find the container with id df340528fc143c897af387e2e5f7a552366d62a7dba66bffe01901d1116f0f34
Nov 02 17:49:07.580407 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.580374    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.580529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.580443    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.580529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.580471    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.662460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.662436    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:49:07.664702 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:07.664659    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05e7c32_f16c_42cb_ab80_7b18b7b7746b.slice/crio-e2cd85af8546c13662c5f1b3f7d7a6ff42555e82f10f20271737c7805ed615bb WatchSource:0}: Error finding container e2cd85af8546c13662c5f1b3f7d7a6ff42555e82f10f20271737c7805ed615bb: Status 404 returned error can't find the container with id e2cd85af8546c13662c5f1b3f7d7a6ff42555e82f10f20271737c7805ed615bb
Nov 02 17:49:07.667266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.667233    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.667347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.667304    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.667394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.667359    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:07.725273 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.725171    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerStarted","Data":"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"}
Nov 02 17:49:07.725273 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.725240    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerStarted","Data":"f52e35d6f76aa3611df60c9e80069921b181cde924638585654bcbaa43a2ca1e"}
Nov 02 17:49:07.726974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.726943    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerStarted","Data":"e2cd85af8546c13662c5f1b3f7d7a6ff42555e82f10f20271737c7805ed615bb"}
Nov 02 17:49:07.729073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.728989    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerStarted","Data":"1071224f66c9dea7ed71c1e33148d8179a3656b5781bac1113d997abeb6f1f87"}
Nov 02 17:49:07.729073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.729040    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerStarted","Data":"df340528fc143c897af387e2e5f7a552366d62a7dba66bffe01901d1116f0f34"}
Nov 02 17:49:07.759705 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.759654    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podStartSLOduration=1.759640476 podStartE2EDuration="1.759640476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:07.75789722 +0000 UTC m=+551.266659286" watchObservedRunningTime="2026-11-02 17:49:07.759640476 +0000 UTC m=+551.268402544"
Nov 02 17:49:07.787006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.786908    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podStartSLOduration=1.78688837 podStartE2EDuration="1.78688837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:07.783309567 +0000 UTC m=+551.292071646" watchObservedRunningTime="2026-11-02 17:49:07.78688837 +0000 UTC m=+551.295650438"
Nov 02 17:49:07.880580 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:07.880545    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:08.232391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.232356    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:08.237569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.237543    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:08.735848 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.735815    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerStarted","Data":"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"}
Nov 02 17:49:08.736357 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.736271    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:08.737124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.737103    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:08.765120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.765076    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podStartSLOduration=1.765062645 podStartE2EDuration="1.765062645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:08.762172393 +0000 UTC m=+552.270934460" watchObservedRunningTime="2026-11-02 17:49:08.765062645 +0000 UTC m=+552.273824714"
Nov 02 17:49:08.887525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:08.887491    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:09.356648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.356615    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:09.361880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.361828    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:09.742419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.742389    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:09.742910 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.742449    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:09.743193 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.743169    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:09.743277 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:09.743265    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:12.377545 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.377509    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 17:49:12.381721 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.381698    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.395903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.395825    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-bb4ecb-serving-cert\""
Nov 02 17:49:12.395903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.395854    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 17:49:12.395903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.395880    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 17:49:12.395903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.395901    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 17:49:12.396123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.395951    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-szhm5\""
Nov 02 17:49:12.404376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.404350    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 17:49:12.456034 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.456001    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.456187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.456105    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.456228 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.456190    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j8wr\" (UniqueName: \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.456285 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.456224    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.556747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.556705    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j8wr\" (UniqueName: \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.556937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.556759    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.556937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.556833    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.556937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.556905    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.557640 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.557615    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.559412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.559390    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.559500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.559429    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.583151 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.583110    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j8wr\" (UniqueName: \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\") pod \"maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.696702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.696674    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:12.980979 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:12.980910    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e56e55_3e4f_4e3c_a339_9cab919c11a5.slice/crio-a6e81c8e5af37d84f6de7511fe9adbbd7a6dec2c59693518a433dfde9d7ddd78 WatchSource:0}: Error finding container a6e81c8e5af37d84f6de7511fe9adbbd7a6dec2c59693518a433dfde9d7ddd78: Status 404 returned error can't find the container with id a6e81c8e5af37d84f6de7511fe9adbbd7a6dec2c59693518a433dfde9d7ddd78
Nov 02 17:49:12.983879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:12.983661    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 17:49:13.553303 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.553269    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 17:49:13.557287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.557262    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.574406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.574354    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-bb4ecb\""
Nov 02 17:49:13.575478 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.575458    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-bb4ecb-dockercfg-vpx5g\""
Nov 02 17:49:13.579449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.579425    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 17:49:13.598177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.598142    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 17:49:13.602370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.602346    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.611599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.611575    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 17:49:13.668543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.668495    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.674056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.674020    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hjbx\" (UniqueName: \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.681824 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.681796    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.693090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.693054    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsvs\" (UniqueName: \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.770500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.770414    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" event={"ID":"20e56e55-3e4f-4e3c-a339-9cab919c11a5","Type":"ContainerStarted","Data":"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"}
Nov 02 17:49:13.770500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.770480    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" event={"ID":"20e56e55-3e4f-4e3c-a339-9cab919c11a5","Type":"ContainerStarted","Data":"a6e81c8e5af37d84f6de7511fe9adbbd7a6dec2c59693518a433dfde9d7ddd78"}
Nov 02 17:49:13.770713 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.770638    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:13.790159 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.790098    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" podStartSLOduration=1.321066896 podStartE2EDuration="1.790082969s" totalImagesPullingTime="469.016073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:13.787353517 +0000 UTC m=+557.296115584" watchObservedRunningTime="2026-11-02 17:49:13.790082969 +0000 UTC m=+557.298845027"
Nov 02 17:49:13.794793 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.794752    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hjbx\" (UniqueName: \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.794975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.794850    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.794975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.794879    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whsvs\" (UniqueName: \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.794975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.794921    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.795641 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.795617    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.795641 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.795632    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.803401 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.803367    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hjbx\" (UniqueName: \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\") pod \"payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.803536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.803486    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsvs\" (UniqueName: \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\") pod \"payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:13.893364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.893327    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:13.944183 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:13.944142    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:14.192317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.192285    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 17:49:14.192831 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:14.192805    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905f9140_3a46_4cac_89af_b6aa42f0724a.slice/crio-5ac88b1c48b7f809991900e0f051495caae005ad8aae0b8bf70860833b1e3588 WatchSource:0}: Error finding container 5ac88b1c48b7f809991900e0f051495caae005ad8aae0b8bf70860833b1e3588: Status 404 returned error can't find the container with id 5ac88b1c48b7f809991900e0f051495caae005ad8aae0b8bf70860833b1e3588
Nov 02 17:49:14.237143 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.237117    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 17:49:14.238416 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:14.238387    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50898e3a_334e_4c6d_9507_676d39acd4ac.slice/crio-0bdc6fe3eea5703954f88cfd26838d1c031c74e63933e977e645cf21b016cd2a WatchSource:0}: Error finding container 0bdc6fe3eea5703954f88cfd26838d1c031c74e63933e977e645cf21b016cd2a: Status 404 returned error can't find the container with id 0bdc6fe3eea5703954f88cfd26838d1c031c74e63933e977e645cf21b016cd2a
Nov 02 17:49:14.534703 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.534619    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:49:14.539339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.539313    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.550977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.550944    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-f37d16-serving-cert\""
Nov 02 17:49:14.552498 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.552473    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:49:14.603868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.603806    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.604309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.603919    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.604309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.604022    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.604309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.604229    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6sj\" (UniqueName: \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.705365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.705330    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.705516 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.705381    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.705516 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.705438    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.705516 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.705497    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6sj\" (UniqueName: \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.706160 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.706132    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.708088 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.708063    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.708176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.708116    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.713948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.713925    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6sj\" (UniqueName: \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\") pod \"maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:14.777543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.777506    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" event={"ID":"50898e3a-334e-4c6d-9507-676d39acd4ac","Type":"ContainerStarted","Data":"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"}
Nov 02 17:49:14.777708 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.777558    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" event={"ID":"50898e3a-334e-4c6d-9507-676d39acd4ac","Type":"ContainerStarted","Data":"0bdc6fe3eea5703954f88cfd26838d1c031c74e63933e977e645cf21b016cd2a"}
Nov 02 17:49:14.777708 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.777630    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:14.779260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.779239    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" event={"ID":"905f9140-3a46-4cac-89af-b6aa42f0724a","Type":"ContainerStarted","Data":"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"}
Nov 02 17:49:14.779360 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.779282    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" event={"ID":"905f9140-3a46-4cac-89af-b6aa42f0724a","Type":"ContainerStarted","Data":"5ac88b1c48b7f809991900e0f051495caae005ad8aae0b8bf70860833b1e3588"}
Nov 02 17:49:14.779426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.779384    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:14.799406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.799309    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" podStartSLOduration=1.7992950460000001 podStartE2EDuration="1.799295046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:14.799238429 +0000 UTC m=+558.308000489" watchObservedRunningTime="2026-11-02 17:49:14.799295046 +0000 UTC m=+558.308057114"
Nov 02 17:49:14.816656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.816596    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" podStartSLOduration=1.816578384 podStartE2EDuration="1.816578384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:14.815141754 +0000 UTC m=+558.323903820" watchObservedRunningTime="2026-11-02 17:49:14.816578384 +0000 UTC m=+558.325340452"
Nov 02 17:49:14.859587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:14.859550    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:15.182723 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.182699    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:49:15.185561 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:15.185529    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2221e6c_39a0_4d1a_b521_4c29aa98e73c.slice/crio-fc5f62ff8f160bdcee4150f03d2fe523ef5a37d473aa0a62c18a056711a4e512 WatchSource:0}: Error finding container fc5f62ff8f160bdcee4150f03d2fe523ef5a37d473aa0a62c18a056711a4e512: Status 404 returned error can't find the container with id fc5f62ff8f160bdcee4150f03d2fe523ef5a37d473aa0a62c18a056711a4e512
Nov 02 17:49:15.365325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.365295    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:15.792828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.792772    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" event={"ID":"b2221e6c-39a0-4d1a-b521-4c29aa98e73c","Type":"ContainerStarted","Data":"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"}
Nov 02 17:49:15.793380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.793355    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" event={"ID":"b2221e6c-39a0-4d1a-b521-4c29aa98e73c","Type":"ContainerStarted","Data":"fc5f62ff8f160bdcee4150f03d2fe523ef5a37d473aa0a62c18a056711a4e512"}
Nov 02 17:49:15.794096 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.794075    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:15.828246 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:15.828183    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" podStartSLOduration=1.430489985 podStartE2EDuration="1.828162712s" totalImagesPullingTime="397.672727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:15.819746786 +0000 UTC m=+559.328508854" watchObservedRunningTime="2026-11-02 17:49:15.828162712 +0000 UTC m=+559.336924780"
Nov 02 17:49:15.863548 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:49:15.863451    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:49:16.511722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.511670    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:49:16.521805 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.521779    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:49:16.522024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.521889    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.532620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.530421    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-9dfa27-dockercfg-77ddw\""
Nov 02 17:49:16.532620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.531473    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-9dfa27\""
Nov 02 17:49:16.658040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.658002    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwgc\" (UniqueName: \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.658242 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.658054    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.759434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.759386    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwgc\" (UniqueName: \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.759434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.759441    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.760328 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.760304    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.769218 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.769146    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwgc\" (UniqueName: \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\") pod \"payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:16.860464 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:16.860437    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:17.204749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.204690    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:49:17.312858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.308927    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:49:17.313648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.313629    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.319629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.319589    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-7b0683-serving-cert\""
Nov 02 17:49:17.321869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.321830    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:49:17.467991 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.467903    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.467991 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.467967    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.468211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.468009    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.468211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.468163    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4j84\" (UniqueName: \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.569092 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.569054    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4j84\" (UniqueName: \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.569302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.569154    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.569302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.569198    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.569302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.569228    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.573875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.570010    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.576699 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.576629    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.583552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.583475    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4j84\" (UniqueName: \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.597861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.591387    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\") pod \"maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.635184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.635145    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:17.813102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.812990    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" event={"ID":"8665639b-ebac-41b8-b9d9-f42f1ea6d496","Type":"ContainerStarted","Data":"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"}
Nov 02 17:49:17.813102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.813061    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" event={"ID":"8665639b-ebac-41b8-b9d9-f42f1ea6d496","Type":"ContainerStarted","Data":"2dbb5396369a8977b3333bbe9b83553130d764c0cc889ad3ea2c39e870ee0f59"}
Nov 02 17:49:17.813300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.813244    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:17.832466 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.832415    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" podStartSLOduration=1.832401639 podStartE2EDuration="1.832401639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:17.829896417 +0000 UTC m=+561.338658484" watchObservedRunningTime="2026-11-02 17:49:17.832401639 +0000 UTC m=+561.341163705"
Nov 02 17:49:17.939847 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:17.939810    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:49:17.941616 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:17.941588    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4535363_5bca_4fa9_9918_5668594f871f.slice/crio-ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4 WatchSource:0}: Error finding container ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4: Status 404 returned error can't find the container with id ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4
Nov 02 17:49:18.833623 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:18.833516    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" event={"ID":"e4535363-5bca-4fa9-9918-5668594f871f","Type":"ContainerStarted","Data":"a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"}
Nov 02 17:49:18.833796 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:18.833661    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:18.833796 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:18.833710    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" event={"ID":"e4535363-5bca-4fa9-9918-5668594f871f","Type":"ContainerStarted","Data":"ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4"}
Nov 02 17:49:18.851941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:18.851894    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" podStartSLOduration=1.240632573 podStartE2EDuration="1.851881158s" totalImagesPullingTime="611.248585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:18.849653117 +0000 UTC m=+562.358415185" watchObservedRunningTime="2026-11-02 17:49:18.851881158 +0000 UTC m=+562.360643264"
Nov 02 17:49:19.214472 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.214440    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 17:49:19.229722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.229678    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:49:19.230121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.230081    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.238885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.234593    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.238885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.234776    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpx5f\" (UniqueName: \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.240045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.240005    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-ea752f-dockercfg-w6hgj\""
Nov 02 17:49:19.240314 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.240297    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 17:49:19.240798 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.240779    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.249167 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.249145    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:49:19.307215 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.307176    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-ea752f\""
Nov 02 17:49:19.329019 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.328992    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-ea3867-serving-cert\""
Nov 02 17:49:19.336040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336010    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjxlz\" (UniqueName: \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.336182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336063    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.336182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336145    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.336257 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336216    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.336295 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336268    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.336329 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.336301    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpx5f\" (UniqueName: \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.337041 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.337009    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.344083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.344060    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpx5f\" (UniqueName: \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\") pod \"payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.437161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.437121    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.437343 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.437203    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjxlz\" (UniqueName: \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.437343 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.437239    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.437343 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.437263    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.437984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.437955    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.439773 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.439751    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.439899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.439803    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.446890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.446867    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjxlz\" (UniqueName: \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\") pod \"maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.575380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.574050    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:19.618106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.618059    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:19.802946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.802913    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 17:49:19.904982 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.904895    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:19.913964 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:19.913935    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565063da_8069_4447_acf9_a39779f5b1eb.slice/crio-d5e1f5168669f96dda79de646959a808c48b4906aedc3bb616b0c25ffadbc363 WatchSource:0}: Error finding container d5e1f5168669f96dda79de646959a808c48b4906aedc3bb616b0c25ffadbc363: Status 404 returned error can't find the container with id d5e1f5168669f96dda79de646959a808c48b4906aedc3bb616b0c25ffadbc363
Nov 02 17:49:19.921138 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.921114    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 17:49:19.950620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:19.950401    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:49:19.951619 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:19.951591    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d64d16_7368_4c53_abdc_0e7412f98392.slice/crio-ade4ba539a590625b9aa1593eff7b3947f86fa31f19d107ee38982e1cf466737 WatchSource:0}: Error finding container ade4ba539a590625b9aa1593eff7b3947f86fa31f19d107ee38982e1cf466737: Status 404 returned error can't find the container with id ade4ba539a590625b9aa1593eff7b3947f86fa31f19d107ee38982e1cf466737
Nov 02 17:49:20.847457 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.847417    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" event={"ID":"565063da-8069-4447-acf9-a39779f5b1eb","Type":"ContainerStarted","Data":"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"}
Nov 02 17:49:20.847911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.847489    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" event={"ID":"565063da-8069-4447-acf9-a39779f5b1eb","Type":"ContainerStarted","Data":"d5e1f5168669f96dda79de646959a808c48b4906aedc3bb616b0c25ffadbc363"}
Nov 02 17:49:20.847911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.847641    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:20.849287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.849261    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" event={"ID":"e7d64d16-7368-4c53-abdc-0e7412f98392","Type":"ContainerStarted","Data":"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"}
Nov 02 17:49:20.849432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.849308    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" event={"ID":"e7d64d16-7368-4c53-abdc-0e7412f98392","Type":"ContainerStarted","Data":"ade4ba539a590625b9aa1593eff7b3947f86fa31f19d107ee38982e1cf466737"}
Nov 02 17:49:20.849541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.849522    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:20.867691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:20.867636    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" podStartSLOduration=1.867618243 podStartE2EDuration="1.867618243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:20.864292163 +0000 UTC m=+564.373054222" watchObservedRunningTime="2026-11-02 17:49:20.867618243 +0000 UTC m=+564.376380311"
Nov 02 17:49:21.227801 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.227752    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" podStartSLOduration=1.7807322829999999 podStartE2EDuration="2.227735693s" totalImagesPullingTime="447.00341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:20.901054435 +0000 UTC m=+564.409816501" watchObservedRunningTime="2026-11-02 17:49:21.227735693 +0000 UTC m=+564.736497760"
Nov 02 17:49:21.230859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.230802    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:49:21.236551 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.236527    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.253392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.253353    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-2a295c-serving-cert\""
Nov 02 17:49:21.253897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.253852    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:49:21.263720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.262722    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.263720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.262774    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.263720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.262817    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.263720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.263078    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j5wq\" (UniqueName: \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.364394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.364361    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j5wq\" (UniqueName: \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.364680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.364658    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.364864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.364822    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.365005 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.364988    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.365459 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.365436    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.367149 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.367130    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.367442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.367417    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.408557 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.408515    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j5wq\" (UniqueName: \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\") pod \"maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.567701 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.567601    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:21.887596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:21.887525    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:49:21.891292 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:21.891268    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0601ac49_9bab_4da7_ac08_b517f90a7be5.slice/crio-665a62e4b3694e245bcc70f7fc3aac640ecc62a9e7d1e151f0d12341096c384d WatchSource:0}: Error finding container 665a62e4b3694e245bcc70f7fc3aac640ecc62a9e7d1e151f0d12341096c384d: Status 404 returned error can't find the container with id 665a62e4b3694e245bcc70f7fc3aac640ecc62a9e7d1e151f0d12341096c384d
Nov 02 17:49:22.821705 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:22.821668    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:49:22.868503 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:22.868467    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" event={"ID":"0601ac49-9bab-4da7-ac08-b517f90a7be5","Type":"ContainerStarted","Data":"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"}
Nov 02 17:49:22.868702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:22.868527    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" event={"ID":"0601ac49-9bab-4da7-ac08-b517f90a7be5","Type":"ContainerStarted","Data":"665a62e4b3694e245bcc70f7fc3aac640ecc62a9e7d1e151f0d12341096c384d"}
Nov 02 17:49:22.868702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:22.868657    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:22.889370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:22.889027    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" podStartSLOduration=1.437732245 podStartE2EDuration="1.889008157s" totalImagesPullingTime="451.275912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:22.885548529 +0000 UTC m=+566.394310627" watchObservedRunningTime="2026-11-02 17:49:22.889008157 +0000 UTC m=+566.397770227"
Nov 02 17:49:24.778866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:24.777939    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:49:24.778866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:24.778006    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:49:24.846537 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:24.846506    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:49:24.922968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:24.922924    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:25.809352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:25.808296    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 17:49:25.810003 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:25.809984    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 17:49:26.861969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:26.861828    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:49:27.035930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.035891    5054 generic.go:356] "Generic (PLEG): container finished" podID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerID="1071224f66c9dea7ed71c1e33148d8179a3656b5781bac1113d997abeb6f1f87" exitCode=0
Nov 02 17:49:27.036310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.036290    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerDied","Data":"1071224f66c9dea7ed71c1e33148d8179a3656b5781bac1113d997abeb6f1f87"}
Nov 02 17:49:27.036930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.036909    5054 scope.go:122] "RemoveContainer" containerID="1071224f66c9dea7ed71c1e33148d8179a3656b5781bac1113d997abeb6f1f87"
Nov 02 17:49:27.039471 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.039433    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:27.040113 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.040088    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:27.040465 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:27.040442    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:28.097722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.097682    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerStarted","Data":"323d045a85f2be3147eebea0fc193eb1ef614b11fb73983874bcd4f9eeb73654"}
Nov 02 17:49:28.239702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.239270    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:28.239702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.239391    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:28.239702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.239444    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:28.856025 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.855995    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:49:28.922065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:28.922019    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:49:29.240683 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:29.240016    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:29.240683 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:29.240082    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:30.233861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:30.233425    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:30.233861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:30.233486    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:31.232902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:31.232451    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:31.232902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:31.232509    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:31.522713 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:31.522639    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:31.862725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:31.862529    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 17:49:32.232743 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:32.232701    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:32.232947 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:32.232768    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:33.236860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.234295    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 02 17:49:33.236860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.234367    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 02 17:49:33.934213 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.934176    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:49:33.939697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.939675    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:33.949797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.949649    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-9dfa27\"/\"kube-root-ca.crt\""
Nov 02 17:49:33.949797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.949763    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-9dfa27\"/\"openshift-service-ca.crt\""
Nov 02 17:49:33.953714 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.953690    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:49:33.964474 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.964431    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9dfa27\"/\"default-dockercfg-kg7p6\""
Nov 02 17:49:33.964636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:33.964575    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9dfa27\"/\"simulator-w1-9dfa27-kserve-self-signed-certs\""
Nov 02 17:49:34.050936 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.050897    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xbn\" (UniqueName: \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.051127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.051024    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.051127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.051088    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.051127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.051119    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.051260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.051240    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.051307 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.051282    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155360 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155312    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155402    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155446    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155539    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155710 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155579    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.155767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.155739    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xbn\" (UniqueName: \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.156646 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.156615    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.157733 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.156955    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.157733 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.157246    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.172045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.166388    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.172045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.168008    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xbn\" (UniqueName: \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.172045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.169106    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\") pod \"simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") " pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.238070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.237985    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:34.238721 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.238695    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:34.239605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.239585    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 17:49:34.259564 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.259539    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:34.561772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:34.561682    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:49:34.562089 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:49:34.562049    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6d643c2_7076_4970_8474_0f0ec75da35a.slice/crio-19b7fdc517790f60e24ef48bee32e084cd83895f2ce58e0e7a8931213e76a7bf WatchSource:0}: Error finding container 19b7fdc517790f60e24ef48bee32e084cd83895f2ce58e0e7a8931213e76a7bf: Status 404 returned error can't find the container with id 19b7fdc517790f60e24ef48bee32e084cd83895f2ce58e0e7a8931213e76a7bf
Nov 02 17:49:35.248566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.248524    5054 generic.go:356] "Generic (PLEG): container finished" podID="28ac0470-6653-4011-ade7-6539315c395b" containerID="47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94" exitCode=0
Nov 02 17:49:35.249146 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.248590    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerDied","Data":"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"}
Nov 02 17:49:35.249146 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.249138    5054 scope.go:122] "RemoveContainer" containerID="47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"
Nov 02 17:49:35.250724 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.250695    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:35.250834 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.250730    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" event={"ID":"e6d643c2-7076-4970-8474-0f0ec75da35a","Type":"ContainerStarted","Data":"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"}
Nov 02 17:49:35.250834 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.250767    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" event={"ID":"e6d643c2-7076-4970-8474-0f0ec75da35a","Type":"ContainerStarted","Data":"19b7fdc517790f60e24ef48bee32e084cd83895f2ce58e0e7a8931213e76a7bf"}
Nov 02 17:49:35.250834 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.250768    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:35.250834 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.250812    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:35.262274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.262243    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:35.297376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:35.296799    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podStartSLOduration=2.29677988 podStartE2EDuration="2.29677988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:49:35.293016594 +0000 UTC m=+578.801778665" watchObservedRunningTime="2026-11-02 17:49:35.29677988 +0000 UTC m=+578.805541949"
Nov 02 17:49:36.259379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.259342    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerStarted","Data":"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"}
Nov 02 17:49:36.260926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.260903    5054 generic.go:356] "Generic (PLEG): container finished" podID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerID="a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97" exitCode=0
Nov 02 17:49:36.261043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.260968    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerDied","Data":"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"}
Nov 02 17:49:36.261325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.261304    5054 scope.go:122] "RemoveContainer" containerID="a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"
Nov 02 17:49:36.262527 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.262498    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:36.262599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.262569    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:36.262651 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.262600    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:49:36.883863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.882309    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:36.883863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.882435    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 02 17:49:36.883863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:36.882491    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 02 17:49:37.274101 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.270274    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerStarted","Data":"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"}
Nov 02 17:49:37.356661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.356630    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:37.357880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.357812    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:37.358094 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.358068    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:37.883274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.883236    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 02 17:49:37.883571 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:37.883544    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 02 17:49:38.356392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:38.356358    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:38.356908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:38.356405    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:38.892860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:38.887243    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 02 17:49:38.892860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:38.887309    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 02 17:49:39.356518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.356484    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:39.356932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.356547    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:39.742432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.742400    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:39.742636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.742471    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:39.884881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.882953    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 02 17:49:39.884881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:39.883014    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 02 17:49:40.356085 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:40.356051    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:40.356263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:40.356098    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:40.884281 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:40.884240    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 02 17:49:40.884955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:40.884913    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 02 17:49:41.356431 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:41.356387    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:41.356620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:41.356454    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:42.139780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:42.139747    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:42.141638 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:42.141605    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:49:42.356246 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:42.355922    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 02 17:49:42.356246 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:42.355981    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 02 17:49:43.360129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:43.360096    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:43.361052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:43.361032    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:49:44.247325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:44.247287    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:44.260435 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:44.260403    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:44.275799 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:44.275767    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:44.394206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:44.394168    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:49:45.837922 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:49:45.837885    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:49:56.498625 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:56.498586    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:49:56.720141 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:56.720112    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:49:56.724115 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:56.724085    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:49:56.726986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:56.726959    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:49:56.730487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:49:56.730463    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:50:00.970478 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.970436    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 17:50:00.976242 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.976216    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:00.985332 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.985308    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bb4ecb\"/\"kube-root-ca.crt\""
Nov 02 17:50:00.988047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.986419    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 17:50:00.988237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.987393    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bb4ecb\"/\"premium-w2-bb4ecb-kserve-self-signed-certs\""
Nov 02 17:50:00.988336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.987449    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bb4ecb\"/\"openshift-service-ca.crt\""
Nov 02 17:50:00.988946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:00.987500    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bb4ecb\"/\"default-dockercfg-gjl4f\""
Nov 02 17:50:01.096965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.096925    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.097130 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.097050    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.097221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.097201    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.097255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.097239    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.097336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.097323    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.097382 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.097366    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74wz\" (UniqueName: \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.198485 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.198447    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.198688 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.198515    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.198998    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199042    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199079    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199172    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74wz\" (UniqueName: \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199230    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199287    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.199800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.199664    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.202067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.202000    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.203334 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.203309    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.208210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.208179    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74wz\" (UniqueName: \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\") pod \"premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") " pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.298950 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.298860    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:01.583651 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:01.583620    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 17:50:01.585245 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:01.585214    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddacc428c_95c0_403d_8898_121bd5455071.slice/crio-acd012c4933d3ba33af882355a3a82bea917da52f26a95ec5d5107a8ef45a1d5 WatchSource:0}: Error finding container acd012c4933d3ba33af882355a3a82bea917da52f26a95ec5d5107a8ef45a1d5: Status 404 returned error can't find the container with id acd012c4933d3ba33af882355a3a82bea917da52f26a95ec5d5107a8ef45a1d5
Nov 02 17:50:02.533428 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:02.533395    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" event={"ID":"dacc428c-95c0-403d-8898-121bd5455071","Type":"ContainerStarted","Data":"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"}
Nov 02 17:50:02.533797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:02.533439    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" event={"ID":"dacc428c-95c0-403d-8898-121bd5455071","Type":"ContainerStarted","Data":"acd012c4933d3ba33af882355a3a82bea917da52f26a95ec5d5107a8ef45a1d5"}
Nov 02 17:50:02.551747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:02.551692    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podStartSLOduration=2.5516787450000002 podStartE2EDuration="2.551678745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:02.549688056 +0000 UTC m=+606.058450119" watchObservedRunningTime="2026-11-02 17:50:02.551678745 +0000 UTC m=+606.060440806"
Nov 02 17:50:03.299161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:03.299123    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:07.159275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:07.159235    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:50:11.296955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.296911    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:50:11.305044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.304269    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:11.305044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.304454    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:50:11.305044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.304594    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.310090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.310065    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ea752f\"/\"default-dockercfg-wm8ft\""
Nov 02 17:50:11.310302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.310286    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ea752f\"/\"kube-root-ca.crt\""
Nov 02 17:50:11.310399 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.310371    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ea752f\"/\"openshift-service-ca.crt\""
Nov 02 17:50:11.310490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.310439    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ea752f\"/\"premium-w4-ea752f-kserve-self-signed-certs\""
Nov 02 17:50:11.323429 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.323398    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:11.421187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421150    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhj4w\" (UniqueName: \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.421373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421304    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.421507 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421491    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.421591 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421572    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.421660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421648    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.421715 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.421672    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.522923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.522887    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.522923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.522951    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.522923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523005    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.522923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523035    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.523438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523091    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhj4w\" (UniqueName: \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.523438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523207    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.523438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523395    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.523438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523407    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.524080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.523894    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.526867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.526533    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.547748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.541314    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.562482 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.562450    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhj4w\" (UniqueName: \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\") pod \"premium-w4-ea752f-kserve-87fc96db4-pwnd4\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") " pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.612108 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.612077    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:50:11.628165 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.628136    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:11.921470 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:11.921437    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:50:11.922916 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:11.922879    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod159635c0_61bb_4fb0_82c5_2d742da70884.slice/crio-21945e34bfafadb45786536a96f9b74a60848864bdf25af702755483c3a8ad6a WatchSource:0}: Error finding container 21945e34bfafadb45786536a96f9b74a60848864bdf25af702755483c3a8ad6a: Status 404 returned error can't find the container with id 21945e34bfafadb45786536a96f9b74a60848864bdf25af702755483c3a8ad6a
Nov 02 17:50:12.619261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:12.619229    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" event={"ID":"159635c0-61bb-4fb0-82c5-2d742da70884","Type":"ContainerStarted","Data":"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"}
Nov 02 17:50:12.619661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:12.619269    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" event={"ID":"159635c0-61bb-4fb0-82c5-2d742da70884","Type":"ContainerStarted","Data":"21945e34bfafadb45786536a96f9b74a60848864bdf25af702755483c3a8ad6a"}
Nov 02 17:50:12.628386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:12.628352    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:12.646033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:12.645959    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podStartSLOduration=1.645943413 podStartE2EDuration="1.645943413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:12.628105602 +0000 UTC m=+616.136867671" watchObservedRunningTime="2026-11-02 17:50:12.645943413 +0000 UTC m=+616.154705542"
Nov 02 17:50:15.843140 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:50:15.843100    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:50:16.636556 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.636523    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:50:16.642263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.642239    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.642616 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.642584    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:50:16.650902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.650076    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-7b0683\"/\"kube-root-ca.crt\""
Nov 02 17:50:16.650902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.650889    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-7b0683\"/\"premium-w6-7b0683-kserve-self-signed-certs\""
Nov 02 17:50:16.651034 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.650988    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-7b0683\"/\"openshift-service-ca.crt\""
Nov 02 17:50:16.651093 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.651053    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-7b0683\"/\"default-dockercfg-jptzs\""
Nov 02 17:50:16.796690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.796658    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.796925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.796715    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.796925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.796804    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.796925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.796904    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngxf\" (UniqueName: \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.797099 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.796992    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.797099 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.797068    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.897741 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.897663    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.897741 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.897713    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.897748    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.897866    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngxf\" (UniqueName: \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.897931    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.898018    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.898158    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.898327    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.898423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.898351    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.900772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.900742    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.900772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.900762    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.908272 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.908243    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngxf\" (UniqueName: \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\") pod \"premium-w6-7b0683-kserve-bb8746494-bfxbf\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") " pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:16.955965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:16.955931    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:17.243471 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:17.243442    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:50:17.246200 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:17.246154    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdd88d33_f173_432e_a69a_a545867cbde2.slice/crio-bc5c06a59fdda790668eed52765208ac5a42ad641fbbb9f35b001478f0db9f0a WatchSource:0}: Error finding container bc5c06a59fdda790668eed52765208ac5a42ad641fbbb9f35b001478f0db9f0a: Status 404 returned error can't find the container with id bc5c06a59fdda790668eed52765208ac5a42ad641fbbb9f35b001478f0db9f0a
Nov 02 17:50:17.646374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:17.646290    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" event={"ID":"bdd88d33-f173-432e-a69a-a545867cbde2","Type":"ContainerStarted","Data":"3303cc3b133cfe359d395974c1075a9688af74010b560f939d4b04f9b5c0e097"}
Nov 02 17:50:17.646374 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:17.646335    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" event={"ID":"bdd88d33-f173-432e-a69a-a545867cbde2","Type":"ContainerStarted","Data":"bc5c06a59fdda790668eed52765208ac5a42ad641fbbb9f35b001478f0db9f0a"}
Nov 02 17:50:17.664763 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:17.664714    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podStartSLOduration=1.664700611 podStartE2EDuration="1.664700611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:17.663014342 +0000 UTC m=+621.171776410" watchObservedRunningTime="2026-11-02 17:50:17.664700611 +0000 UTC m=+621.173462677"
Nov 02 17:50:17.956203 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:17.956173    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:21.088492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.088446    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:50:21.629506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.628641    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:21.642127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.642089    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:21.696581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.696254    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:50:21.901737 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.901657    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:50:21.906886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.906858    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.914196 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.914169    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-9dfa27-openshift-default-dockercfg-z57p2\""
Nov 02 17:50:21.919036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.919007    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:50:21.964855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.964803    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.964902    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.964937    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.964992    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.965027    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.965111    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.965164    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m58n\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.965213    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:21.965274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:21.965255    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066119    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066200    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m58n\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066247    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066296    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066372    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066414    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066451    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066515    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066553    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066716    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.066872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.066830    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.067133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.067107    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.067375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.067350    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.067424 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.067353    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.068941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.068921    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.069190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.069169    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.078736 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.078705    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.078880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.078740    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m58n\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.225267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.225222    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:22.528073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.528040    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:50:22.528559 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:22.528524    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f7ddb6_ca43_483f_b162_348cb611ff8b.slice/crio-c06f2ec8b6cd5abd4ff47805bebe34f2e50e9852cd9b254712c3b9f728c1f255 WatchSource:0}: Error finding container c06f2ec8b6cd5abd4ff47805bebe34f2e50e9852cd9b254712c3b9f728c1f255: Status 404 returned error can't find the container with id c06f2ec8b6cd5abd4ff47805bebe34f2e50e9852cd9b254712c3b9f728c1f255
Nov 02 17:50:22.531586 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.531541    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:22.531706 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.531638    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:22.531706 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.531681    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:22.704268 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.704235    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" event={"ID":"46f7ddb6-ca43-483f-b162-348cb611ff8b","Type":"ContainerStarted","Data":"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"}
Nov 02 17:50:22.704533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.704511    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" event={"ID":"46f7ddb6-ca43-483f-b162-348cb611ff8b","Type":"ContainerStarted","Data":"c06f2ec8b6cd5abd4ff47805bebe34f2e50e9852cd9b254712c3b9f728c1f255"}
Nov 02 17:50:22.741859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:22.739438    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podStartSLOduration=1.739417747 podStartE2EDuration="1.739417747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:22.735398935 +0000 UTC m=+626.244161004" watchObservedRunningTime="2026-11-02 17:50:22.739417747 +0000 UTC m=+626.248179814"
Nov 02 17:50:23.226460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:23.226425    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:23.228376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:23.228344    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:23.228505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:23.228391    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:24.226228 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:24.226185    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:24.226481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:24.226265    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:25.226104 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:25.226063    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:25.226290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:25.226115    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:26.226114 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:26.226071    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:26.226520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:26.226149    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:26.956154 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:26.956114    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:26.998735 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:26.998699    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:27.226067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:27.225994    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:27.226067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:27.226053    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:27.758959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:27.758931    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:50:28.225726 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:28.225689    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:28.225935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:28.225741    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:29.226135 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:29.226096    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 02 17:50:29.226530 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:29.226154    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 02 17:50:30.231210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:30.231174    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:30.231720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:30.231603    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:30.232365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:30.232346    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:50:36.882043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.882006    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 17:50:36.888590 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.888569    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.893997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.893971    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ea752f-openshift-default-dockercfg-dsvkg\""
Nov 02 17:50:36.900888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.900860    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 17:50:36.964481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964446    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964513    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964549    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964581    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964610    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964650    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.964689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964670    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.965011 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964709    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:36.965011 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:36.964747    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrgs\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068370    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068612 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068440    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrgs\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068612 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068502    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068612 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068568    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068611    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068661    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068694    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068744    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.068781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.068777    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.069519 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.069489    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.069750 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.069730    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.070315 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.070293    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.071349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.070644    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.071640 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.071614    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.073879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.073828    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.074432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.074404    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.077804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.077746    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrgs\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.078685 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.078667    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.209716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.209662    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:37.451135 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.451101    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:50:37.456234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.456211    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.464878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.464816    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-7b0683-openshift-default-dockercfg-rp64v\""
Nov 02 17:50:37.470602 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.470574    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:50:37.514604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.513547    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 17:50:37.515386 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:37.515357    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5847ab4b_c016_4075_a990_994effeda769.slice/crio-4f85643a8f261e210245f8c04d6ae2a10839b14aad383707d31cd0be63d7353e WatchSource:0}: Error finding container 4f85643a8f261e210245f8c04d6ae2a10839b14aad383707d31cd0be63d7353e: Status 404 returned error can't find the container with id 4f85643a8f261e210245f8c04d6ae2a10839b14aad383707d31cd0be63d7353e
Nov 02 17:50:37.518580 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.518537    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:37.518712 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.518630    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:37.518712 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.518676    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575150    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575220    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575293    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575351    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575405    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575435    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89hxs\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575520    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575548    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.575863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.575591    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.676932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.676895    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.676945    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.676985    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677058    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677102    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677160    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677219    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677275    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.677364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677309    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89hxs\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.678127 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.677984    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.678257 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.678182    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.679191 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.679160    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.679683 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.679662    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.680352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.680329    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.680490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.680395    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.681381 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.681357    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.686893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.686868    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89hxs\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.687789 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.687765    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.780438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.780347    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:37.839187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.839146    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" event={"ID":"5847ab4b-c016-4075-a990-994effeda769","Type":"ContainerStarted","Data":"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"}
Nov 02 17:50:37.839382 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.839214    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" event={"ID":"5847ab4b-c016-4075-a990-994effeda769","Type":"ContainerStarted","Data":"4f85643a8f261e210245f8c04d6ae2a10839b14aad383707d31cd0be63d7353e"}
Nov 02 17:50:37.883019 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:37.880967    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podStartSLOduration=1.880947501 podStartE2EDuration="1.880947501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:37.87744291 +0000 UTC m=+641.386204978" watchObservedRunningTime="2026-11-02 17:50:37.880947501 +0000 UTC m=+641.389709571"
Nov 02 17:50:38.087217 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:50:38.087175    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc804d118_2026_4c0f_ae59_0734d8817682.slice/crio-9f5e4623e8c0d757147c3e3a04cc84ce70bc3fabe3887770d0df3fefc2096935 WatchSource:0}: Error finding container 9f5e4623e8c0d757147c3e3a04cc84ce70bc3fabe3887770d0df3fefc2096935: Status 404 returned error can't find the container with id 9f5e4623e8c0d757147c3e3a04cc84ce70bc3fabe3887770d0df3fefc2096935
Nov 02 17:50:38.088830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.088789    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:50:38.090768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.090728    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:38.090878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.090830    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:38.090919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.090897    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:50:38.213211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.213178    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:38.213390 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.213364    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:38.213462 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.213410    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:38.850882 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.850833    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" event={"ID":"c804d118-2026-4c0f-ae59-0734d8817682","Type":"ContainerStarted","Data":"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"}
Nov 02 17:50:38.851062 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.850901    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" event={"ID":"c804d118-2026-4c0f-ae59-0734d8817682","Type":"ContainerStarted","Data":"9f5e4623e8c0d757147c3e3a04cc84ce70bc3fabe3887770d0df3fefc2096935"}
Nov 02 17:50:38.896304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:38.896236    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podStartSLOduration=1.896214466 podStartE2EDuration="1.896214466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:50:38.895111282 +0000 UTC m=+642.403873351" watchObservedRunningTime="2026-11-02 17:50:38.896214466 +0000 UTC m=+642.404976533"
Nov 02 17:50:39.223859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:39.223805    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:39.224082 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:39.223883    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:39.786872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:39.786315    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:39.787084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:39.786895    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:39.787084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:39.786942    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:40.218860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:40.218193    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:40.218860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:40.218256    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:40.784863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:40.784118    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:40.784863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:40.784192    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:41.212235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:41.212197    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:41.212526 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:41.212499    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:41.783700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:41.783233    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:41.783700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:41.783297    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:42.212859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:42.212585    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:42.212859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:42.212656    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:42.791865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:42.781266    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:42.791865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:42.781333    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:43.214862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:43.213935    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:43.214862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:43.214010    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:43.787862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:43.786234    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:43.787862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:43.786301    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:44.213880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:44.213190    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 17:50:44.213880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:44.213258    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 17:50:44.783877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:44.781350    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 17:50:44.783877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:44.781421    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 17:50:45.217240 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.217202    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:45.217820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.217792    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:45.218635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.218615    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 17:50:45.786010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.785978    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:45.786264 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.786245    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:45.787189 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:45.787169    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:50:45.838723 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:50:45.838687    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:50:53.795857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:50:53.795802    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:51:15.867921 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:51:15.867792    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:51:26.259866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:26.255942    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:51:26.259866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:26.256043    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:26.279862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:26.277914    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:51:26.279862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:26.277985    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:34.806602 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:34.806563    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:51:37.432631 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.432594    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:51:37.465863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.459447    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.493902 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.460777    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gkk5\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.494223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.494191    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.575075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.575031    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.575358 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.575334    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.579914    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.583971    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.584019    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.584206    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.584272    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.496221    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-ea3867-openshift-default-dockercfg-sdtfb\""
Nov 02 17:51:37.603863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.595192    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:51:37.658887 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.609273    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:37.686416 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.686323    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.686663 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.686642    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.690871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.687292    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.690871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.688216    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.691266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.686832    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gkk5\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.691438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.691418    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.691595 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.691579    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.691701 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.691686    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.707874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.703087    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.707874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.703162    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.707874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.703196    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.707874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.706955    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.707874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.707288    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.708266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.707968    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.708329 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.708286    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.759872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.754112    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gkk5\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.759872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.754637    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.759872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.754715    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:37.958874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:37.958774    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:38.321064 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.321026    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:51:38.329870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.329331    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:38.329870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.329421    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:38.329870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.329479    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:38.648111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.648020    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" event={"ID":"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3","Type":"ContainerStarted","Data":"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"}
Nov 02 17:51:38.649629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.648648    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" event={"ID":"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3","Type":"ContainerStarted","Data":"fb0a944556fe070b667fc880a7eac1dde38aca7c2acab6ea52379c1db2088402"}
Nov 02 17:51:38.679649 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.673813    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podStartSLOduration=1.673795106 podStartE2EDuration="1.673795106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:38.673089069 +0000 UTC m=+702.181851128" watchObservedRunningTime="2026-11-02 17:51:38.673795106 +0000 UTC m=+702.182557174"
Nov 02 17:51:38.959299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:38.959264    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:39.960632 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:39.960593    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:39.961088 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:39.960664    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:40.959745 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:40.959703    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:40.960091 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:40.959774    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:41.959757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:41.959718    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:41.960191 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:41.959775    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:42.959211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:42.959178    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:42.959388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:42.959237    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:43.959982 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:43.959944    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:43.960389 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:43.959999    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:44.959832 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:44.959788    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 17:51:44.960019 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:44.959874    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 17:51:45.845941 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:51:45.845895    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:51:46.440391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.440357    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:46.442691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.442669    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:46.454461 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.454420    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:51:46.731644 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.731568    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"]
Nov 02 17:51:46.737042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.737014    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.777412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.777372    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"]
Nov 02 17:51:46.825862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.804693    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.826325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.826219    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.872644 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.872583    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.873112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.873007    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.873112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.873084    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.897133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.897091    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.909121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.909013    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.909121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.909083    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn722\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-kube-api-access-gn722\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:46.916948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:46.916874    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.044558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.044462    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.044856 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.044813    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045059    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045258    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045393 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045377    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn722\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-kube-api-access-gn722\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045536    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045701 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045685    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045805    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.045983 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.045966    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.046449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.046426    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.047365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.047341    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.080861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.048008    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.081986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.081954    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.083876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.083816    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.101353 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.100596    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.126621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.126587    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn722\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-kube-api-access-gn722\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.139860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.138428    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.139860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.138887    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed01a4fb-b9a6-412a-9405-e5642d0ce442-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9qwsm\" (UID: \"ed01a4fb-b9a6-412a-9405-e5642d0ce442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.212270 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.209898    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:47.782543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.782513    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"]
Nov 02 17:51:47.784327 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:51:47.784297    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded01a4fb_b9a6_412a_9405_e5642d0ce442.slice/crio-ad17ee52a47956fadd31b80f591baee61530801c1a3063182beeba66870fbe46 WatchSource:0}: Error finding container ad17ee52a47956fadd31b80f591baee61530801c1a3063182beeba66870fbe46: Status 404 returned error can't find the container with id ad17ee52a47956fadd31b80f591baee61530801c1a3063182beeba66870fbe46
Nov 02 17:51:47.787041 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.787001    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:47.787129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.787085    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:47.787173 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.787126    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:47.917602 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.917503    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" event={"ID":"ed01a4fb-b9a6-412a-9405-e5642d0ce442","Type":"ContainerStarted","Data":"c5570852aeb7ab72d684347ba5fc79abc20affda3e914402aa114f814d40c0f0"}
Nov 02 17:51:47.917602 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.917567    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" event={"ID":"ed01a4fb-b9a6-412a-9405-e5642d0ce442","Type":"ContainerStarted","Data":"ad17ee52a47956fadd31b80f591baee61530801c1a3063182beeba66870fbe46"}
Nov 02 17:51:47.944150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:47.944094    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podStartSLOduration=1.944076431 podStartE2EDuration="1.944076431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:47.941118103 +0000 UTC m=+711.449880169" watchObservedRunningTime="2026-11-02 17:51:47.944076431 +0000 UTC m=+711.452838498"
Nov 02 17:51:48.212376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:48.212348    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:48.213631 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:48.213601    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:48.213757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:48.213656    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:49.213780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:49.213240    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:49.213780 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:49.213298    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:50.213104 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.213071    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:50.213283 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.213133    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:50.444047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.444010    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:51:50.448452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.448426    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.448668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.448643    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:51:50.458174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.458149    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9dfa27\"/\"distinct-w1-9dfa27-kserve-self-signed-certs\""
Nov 02 17:51:50.540820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.540703    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.540820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.540803    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.541098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.540915    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.541098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.540985    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.541098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.541020    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.541266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.541103    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrpn\" (UniqueName: \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.641901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.641861    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.641901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.641899    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.642116 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.641931    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.642116 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.641951    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.642116 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.642012    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrpn\" (UniqueName: \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.642211 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.642139    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.642596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.642568    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.643204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.643178    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.643356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.643306    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.644888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.644866    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.644999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.644986    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.659420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.659395    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrpn\" (UniqueName: \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\") pod \"distinct-w1-9dfa27-kserve-fd7cc5599-flgjp\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") " pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:50.763381 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:50.763342    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:51.099736 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.099704    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:51:51.213855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.213244    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:51.213855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.213319    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:51.944010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.943970    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" event={"ID":"77f0e0b7-d25d-478f-9e6d-4a8ee454f206","Type":"ContainerStarted","Data":"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"}
Nov 02 17:51:51.944462 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.944022    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" event={"ID":"77f0e0b7-d25d-478f-9e6d-4a8ee454f206","Type":"ContainerStarted","Data":"2dedbfebf2a5e77a01a7fbcaa1f8ea66f5a7ef19dcf35fc8ddb89cfb1d51b401"}
Nov 02 17:51:51.969804 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:51.969757    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podStartSLOduration=1.969743332 podStartE2EDuration="1.969743332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:51.966447005 +0000 UTC m=+715.475209072" watchObservedRunningTime="2026-11-02 17:51:51.969743332 +0000 UTC m=+715.478505399"
Nov 02 17:51:52.029515 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.029482    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 17:51:52.033380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.033353    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.112979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.105771    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 17:51:52.159715 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.159679    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.159955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.159737    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.159955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.159867    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.159955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.159907    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.159955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.159943    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slqkn\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.160188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.160029    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.160188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.160150    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.160317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.160207    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.160317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.160234    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.212815 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.212731    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:52.212815 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.212798    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:52.261683 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261649    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.261870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261700    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.261870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261737    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.261870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261765    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.261870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261795    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slqkn\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.261870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261821    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261899    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261931    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.261960    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262292 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.262211    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.262407    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262498 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.262455    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.262502    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.262737 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.262716    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.264081 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.264063    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.264597 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.264578    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.303962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.303930    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.304111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.304087    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slqkn\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.347177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.347147    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:52.408234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.408202    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:51:52.412725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.412698    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.459532 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.459506    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:51:52.468013 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.467780    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468013 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.467943    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468013 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468002    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wjk\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468038    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468089    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468126    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468173    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468240    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.468499 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.468363    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.569983    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570044    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570089    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wjk\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570125    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570171    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570209    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570255    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570323    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.570403    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.571248    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.575874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.571544    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.601467 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.601434    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.601702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.601614    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.601822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.601761    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.604006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.603962    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.605632 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.605609    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.610377 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.610348    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.614698 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.614670    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wjk\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.710877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.701826    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:51:52.718189 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.717141    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.729855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.724869    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 17:51:52.729855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.727950    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:52.730228 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.730141    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:51:52.734896 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:51:52.734375    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd10872f_54d6_46db_954f_ae6162ac8247.slice/crio-0febfd1d21f7960f34ea3cb25d9af7052ff08797c9cfb26fb693035a21980489 WatchSource:0}: Error finding container 0febfd1d21f7960f34ea3cb25d9af7052ff08797c9cfb26fb693035a21980489: Status 404 returned error can't find the container with id 0febfd1d21f7960f34ea3cb25d9af7052ff08797c9cfb26fb693035a21980489
Nov 02 17:51:52.739633 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.739592    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:52.739711 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.739675    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:52.739749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.739719    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:52.764074 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.764030    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805350    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805476    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805506    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805609    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805640    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805673    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805714    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805733    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tdhl\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.807890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.805762    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909260    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909336    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909440    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909472    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909566    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909656    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909713    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909779    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.909809    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tdhl\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.910543    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.911040    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.911949    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.912186    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.912804    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.917553    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.919662    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.929055    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.929862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.929671    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tdhl\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:52.958587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.958402    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" event={"ID":"dd10872f-54d6-46db-954f-ae6162ac8247","Type":"ContainerStarted","Data":"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"}
Nov 02 17:51:52.958587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:52.958462    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" event={"ID":"dd10872f-54d6-46db-954f-ae6162ac8247","Type":"ContainerStarted","Data":"0febfd1d21f7960f34ea3cb25d9af7052ff08797c9cfb26fb693035a21980489"}
Nov 02 17:51:53.012944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.012653    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podStartSLOduration=2.012636157 podStartE2EDuration="2.012636157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:52.994320153 +0000 UTC m=+716.503082254" watchObservedRunningTime="2026-11-02 17:51:53.012636157 +0000 UTC m=+716.521398223"
Nov 02 17:51:53.035391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.035347    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:53.141958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.139377    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:51:53.142492 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:51:53.142464    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f955e31_53cd_4d5a_9c99_963e15579040.slice/crio-d869d7540d25009c5bc9feade89ae2aecaa5b1844f722c481b40635a861dd4d5 WatchSource:0}: Error finding container d869d7540d25009c5bc9feade89ae2aecaa5b1844f722c481b40635a861dd4d5: Status 404 returned error can't find the container with id d869d7540d25009c5bc9feade89ae2aecaa5b1844f722c481b40635a861dd4d5
Nov 02 17:51:53.145221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.145178    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.146050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.146023    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.146226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.146208    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.219579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.219104    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:53.219579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.219178    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:53.347763 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.347728    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:51:53.348914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.348887    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:53.349046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.348936    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:53.457401 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.457370    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:51:53.464425 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:51:53.464389    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748de55d_c7a4_4f7e_bdf1_99e9f2ae6924.slice/crio-343e948a5db0e3147c2d67c0a692355f113a9eef66739479274a520f645054fa WatchSource:0}: Error finding container 343e948a5db0e3147c2d67c0a692355f113a9eef66739479274a520f645054fa: Status 404 returned error can't find the container with id 343e948a5db0e3147c2d67c0a692355f113a9eef66739479274a520f645054fa
Nov 02 17:51:53.467930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.467501    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.467930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.467567    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.467930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.467599    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:51:53.966667 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.966619    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" event={"ID":"0f955e31-53cd-4d5a-9c99-963e15579040","Type":"ContainerStarted","Data":"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"}
Nov 02 17:51:53.967156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.966726    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" event={"ID":"0f955e31-53cd-4d5a-9c99-963e15579040","Type":"ContainerStarted","Data":"d869d7540d25009c5bc9feade89ae2aecaa5b1844f722c481b40635a861dd4d5"}
Nov 02 17:51:53.968754 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.968722    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" event={"ID":"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924","Type":"ContainerStarted","Data":"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"}
Nov 02 17:51:53.984245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:53.968783    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" event={"ID":"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924","Type":"ContainerStarted","Data":"343e948a5db0e3147c2d67c0a692355f113a9eef66739479274a520f645054fa"}
Nov 02 17:51:54.036303 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.036267    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:51:54.037686 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.037656    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:54.037899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.037871    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:54.060056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.059989    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podStartSLOduration=2.059969296 podStartE2EDuration="2.059969296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:54.024351713 +0000 UTC m=+717.533113781" watchObservedRunningTime="2026-11-02 17:51:54.059969296 +0000 UTC m=+717.568731361"
Nov 02 17:51:54.060621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.060589    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podStartSLOduration=2.060580954 podStartE2EDuration="2.060580954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:51:54.055681003 +0000 UTC m=+717.564443072" watchObservedRunningTime="2026-11-02 17:51:54.060580954 +0000 UTC m=+717.569343020"
Nov 02 17:51:54.213345 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.213306    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:54.213760 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.213729    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:54.351227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.351135    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:54.351477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.351450    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:54.730542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.730507    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:51:54.730918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.730891    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:54.731118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:54.731093    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:55.037919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.037248    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:55.037919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.037311    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:55.236908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.229656    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 17:51:55.236908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.229716    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 17:51:55.349347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.349253    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:55.349611 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.349581    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:55.736553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.736518    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:55.736810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:55.736782    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:56.046993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.046888    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:56.047610 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.047553    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:56.413621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.413577    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:56.430897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.430445    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:56.430897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.430500    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:56.640659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.640613    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:56.737004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.736090    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:56.737004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.736150    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:56.770546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:56.770506    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:51:57.099944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.095347    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:57.100564 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.100525    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:57.189906 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.186183    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:57.359992 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.359905    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:57.360244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.360214    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:57.423525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.423481    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:57.424282 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.424246    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:51:57.463290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.463242    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:51:57.463604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.463559    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:57.649914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.647083    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:57.662443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.659564    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:51:57.715858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.700512    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:51:57.758744 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.758687    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:57.758971 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.758764    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:57.777274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.777215    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:57.778086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:57.778063    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:51:58.111868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.110989    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:58.111868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.111051    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:58.209864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.187680    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:58.210759 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.210730    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:51:58.401925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.398639    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:58.401925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.398703    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:58.430863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.424760    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:58.496863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.476925    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:51:58.496863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.476990    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:58.549898 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.549674    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:51:58.579864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.579120    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:58.604868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.581102    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:58.693878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.690085    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:58.742890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.742816    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:58.746993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.746951    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:58.801863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.782957    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:58.893933 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.893902    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm"
Nov 02 17:51:58.894175 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.894160    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:51:58.977919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:58.970600    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:51:59.054867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.052745    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:51:59.054867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.052806    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:51:59.386241 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.386141    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": context deadline exceeded"
Nov 02 17:51:59.392022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.391977    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:51:59.392226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.392199    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:51:59.709866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.707929    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:51:59.718601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.718561    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:59.749868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.742807    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:51:59.749868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.742883    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:51:59.804868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.804711    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:51:59.972905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:51:59.972634    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:00.047702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.047663    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:52:00.048008 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.047979    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:52:00.365937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.359067    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:52:00.365937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.359138    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:52:00.730380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.722941    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:00.730380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.730179    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:52:00.730380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.730234    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:52:00.782881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.781726    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:52:00.838903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:00.826901    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:01.055189 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.055101    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:52:01.055423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.055393    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:52:01.349587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.349486    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 17:52:01.350360 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.349817    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 17:52:01.554239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.554191    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:01.693990 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.693929    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:01.727029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.726968    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:01.728647 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.728610    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 02 17:52:01.728900 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.728879    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 02 17:52:01.784016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.783971    5054 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": context deadline exceeded"
Nov 02 17:52:01.858719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.858652    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:01.887227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:01.887183    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:52:02.053261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:02.053174    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 17:52:02.053531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:02.053499    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 17:52:02.061542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:02.061509    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:52:02.435219 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:02.434974    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:52:03.051264 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.051229    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:52:03.053278 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.053255    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:52:03.055021 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.055001    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:52:03.207273 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.207238    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:52:03.217754 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.217730    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:52:03.227206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.227165    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:52:03.398917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.395010    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:52:03.398917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.395074    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:03.686864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.685998    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:52:03.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.687484    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:52:03.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:03.689956    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 17:52:06.872539 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.872504    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:52:06.877948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.877928    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.898412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.898385    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:52:06.934070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.934036    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:52:06.939187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.939160    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.961109 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.961078    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969171    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969232    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969274    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969301    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969333    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969356    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969428    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969454    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969503    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969565    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969615    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969638    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq6s\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969670    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969742    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969776    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:06.969911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.969819    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.971003 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.970917    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpd78\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:06.971163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:06.970970    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072351    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072404    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072422    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq6s\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072442    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072482    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072502    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072535    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.072929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072579    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpd78\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.072929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072724    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072818    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.072929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072889    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072936    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072967    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.072998    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073001    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073022    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073052    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073125 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073105    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073132    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073168    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073188    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073237    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073274    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073372    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073451    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.073880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.073652    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.074086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.074065    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.074152 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.074078    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.075400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.075377    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.076429 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.076407    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.076542 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.076512    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.076775 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.076756    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.084598 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.084574    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.086787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.086431    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq6s\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.086787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.086746    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpd78\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.089065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.089033    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\") pod \"e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") " pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.198814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.198774    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:52:07.204446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.204419    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:07.209015 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.208686    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.219467 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.219432    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:52:07.258619 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.258409    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.285725    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.285805    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.285908    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.285942    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.286046    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.286076    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.286139    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcj49\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.286176    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.286412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.286225    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.292116 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.292087    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 17:52:07.298412 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.298388    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.306156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.306127    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 17:52:07.388207 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388162    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49qg\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.388364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388272    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.388364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388336    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388372    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388418    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.388609 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388530    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388609 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388566    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388609 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388602    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.388829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388662    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcj49\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388701    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388748    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.388829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388776    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.388829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388800    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.389352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.388831    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.389352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.389323    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.390129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.390096    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.390244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.390147    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.390244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.390215    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.390568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.390543    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.390998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.390977    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.391097 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.391059    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.391351 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.391328    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.391558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.391539    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.393012 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.392984    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.393100 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.393032    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.413783 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.413726    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcj49\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.416441 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.416413    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508646    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508767    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508872    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508895    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508924    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.508971    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.509007    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.509104    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49qg\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.513581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.509140    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.514417 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.514384    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.514520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.514462    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.515375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.514857    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.515375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.515197    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.515375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.515320    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.515852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.515814    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.523892 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.517187    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.538672 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.538590    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49qg\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.546086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.545978    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.560801 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.560545    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:07.568981 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:52:07.568944    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a3ed4e_2dcf_4683_ab05_8c140a5658db.slice/crio-8cc4d6e00cbe925543ca4a578c4a08a00b37298796ae96b99251d14870e6b2ae WatchSource:0}: Error finding container 8cc4d6e00cbe925543ca4a578c4a08a00b37298796ae96b99251d14870e6b2ae: Status 404 returned error can't find the container with id 8cc4d6e00cbe925543ca4a578c4a08a00b37298796ae96b99251d14870e6b2ae
Nov 02 17:52:07.571487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.571445    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:52:07.577260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.577214    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.577364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.577316    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.577405 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.577359    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.628120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.628007    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:52:07.634081 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.632914    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:07.642024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.636724    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.642024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.636817    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.642024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.636892    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.677239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.677208    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" event={"ID":"71a3ed4e-2dcf-4683-ab05-8c140a5658db","Type":"ContainerStarted","Data":"8cc4d6e00cbe925543ca4a578c4a08a00b37298796ae96b99251d14870e6b2ae"}
Nov 02 17:52:07.678713 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.678687    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" event={"ID":"6f6d507b-c995-4b15-8599-918ad9499f8b","Type":"ContainerStarted","Data":"d0976e022297e8344c70144be00332489080af56e6e733d55f708349e62a71cf"}
Nov 02 17:52:07.892371 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:52:07.892336    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode180d7f9_4e30_4441_bd7f_7837dd79a063.slice/crio-1d09b01bf86582aad8af0c07926d7c30dbafe57ff514287b1f954fd088d61f2a WatchSource:0}: Error finding container 1d09b01bf86582aad8af0c07926d7c30dbafe57ff514287b1f954fd088d61f2a: Status 404 returned error can't find the container with id 1d09b01bf86582aad8af0c07926d7c30dbafe57ff514287b1f954fd088d61f2a
Nov 02 17:52:07.894457 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.894422    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:52:07.895644 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.895611    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.895749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.895693    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:07.895749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:07.895742    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:08.027363 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:08.027285    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 17:52:08.031816 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:08.031779    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:08.031977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:08.031873    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:08.031977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:08.031903    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:09.051863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.050393    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" event={"ID":"71a3ed4e-2dcf-4683-ab05-8c140a5658db","Type":"ContainerStarted","Data":"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"}
Nov 02 17:52:09.208944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.208907    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:09.305917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.292375    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podStartSLOduration=3.292350761 podStartE2EDuration="3.292350761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:09.098611696 +0000 UTC m=+732.607373765" watchObservedRunningTime="2026-11-02 17:52:09.292350761 +0000 UTC m=+732.801112829"
Nov 02 17:52:09.361886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.303514    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" event={"ID":"6f6d507b-c995-4b15-8599-918ad9499f8b","Type":"ContainerStarted","Data":"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"}
Nov 02 17:52:09.362188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.362163    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:09.362378 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.307120    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:09.362541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.362514    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:09.362662 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.328891    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:09.362759 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.362742    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:09.381015 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.380950    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podStartSLOduration=3.38092972 podStartE2EDuration="3.38092972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:09.363120872 +0000 UTC m=+732.871882917" watchObservedRunningTime="2026-11-02 17:52:09.38092972 +0000 UTC m=+732.889691788"
Nov 02 17:52:09.430772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.430718    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" event={"ID":"e180d7f9-4e30-4441-bd7f-7837dd79a063","Type":"ContainerStarted","Data":"96a162780ad54e4c506553445304ebeca5993f710a2b0688a51654e9d78b65f2"}
Nov 02 17:52:09.431189 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.431071    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" event={"ID":"e180d7f9-4e30-4441-bd7f-7837dd79a063","Type":"ContainerStarted","Data":"1d09b01bf86582aad8af0c07926d7c30dbafe57ff514287b1f954fd088d61f2a"}
Nov 02 17:52:09.492869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.485941    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" event={"ID":"c0f62f1e-d291-4a97-bdde-937c695623a6","Type":"ContainerStarted","Data":"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"}
Nov 02 17:52:09.493150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.493118    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" event={"ID":"c0f62f1e-d291-4a97-bdde-937c695623a6","Type":"ContainerStarted","Data":"3bacf20b6d94a334d01413ac4ffe92e4783c7ca4deb6173cdfdf12b8377e86d0"}
Nov 02 17:52:09.562925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.556863    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podStartSLOduration=2.556822434 podStartE2EDuration="2.556822434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:09.46537479 +0000 UTC m=+732.974136858" watchObservedRunningTime="2026-11-02 17:52:09.556822434 +0000 UTC m=+733.065584501"
Nov 02 17:52:09.566235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.566203    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:09.584864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.571685    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podStartSLOduration=2.5716703560000003 podStartE2EDuration="2.571670356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:09.535387774 +0000 UTC m=+733.044149843" watchObservedRunningTime="2026-11-02 17:52:09.571670356 +0000 UTC m=+733.080432423"
Nov 02 17:52:09.585243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.585210    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:09.585426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.585400    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:09.660995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.660957    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:09.661381 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.661357    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:09.665120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:09.665078    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:10.030863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.028951    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:10.209051 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.209015    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:10.209645 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.209590    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:10.272395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.271423    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:10.272395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.271487    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:10.556722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.555920    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:10.565632 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.565596    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:10.565987 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.565947    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:10.656886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.651519    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:10.656886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.651582    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:10.713860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.710701    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:52:10.844524 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.833246    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:10.844524 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:10.835302    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:11.217875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.215902    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:11.217875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.215974    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:11.274472 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.274024    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:11.274472 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.274087    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:11.562498 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.562397    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:11.562793 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.562745    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:11.637870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.635828    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:11.637870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.635909    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:11.714874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.710927    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:11.714874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.711360    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:52:11.791870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.788541    5054 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:11.857546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.834924    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:11.857546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.835716    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:52:11.861832 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.858329    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:11.861832 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.858656    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:52:11.990876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:11.983980    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:12.224888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.218611    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:12.224888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.218687    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:12.266208 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.266148    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:12.279863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.269951    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:12.310065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.310014    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:12.557187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.554514    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:52:12.562587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.562549    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:12.562877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.562815    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:12.570510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.570480    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:52:12.633864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.633071    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:12.641864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.637925    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:12.641864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.637979    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:12.743792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.722978    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:12.845424 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:12.841254    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:52:13.208860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.208234    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:13.208860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.208300    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:13.263861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.263377    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:13.263861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.263437    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:13.561055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.560947    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:52:13.561723 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.561694    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:52:13.564438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.564409    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:52:13.565566 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.565545    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:13.565734 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.565712    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:13.733030 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.732969    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:13.813955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.804575    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:13.813955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.804647    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:13.853880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.842935    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:14.001865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:13.986969    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:14.213861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.213436    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:14.213861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.213494    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:14.278864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.278698    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:14.278864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.278772    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:14.569915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.562361    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:14.569915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.564111    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:14.569915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.564175    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:14.655617 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.655582    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:14.655932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.655888    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:14.815890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.782937    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:52:14.853931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.843970    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:14.996867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.995898    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:14.996867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:14.996664    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:52:15.183879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.179113    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:52:15.308876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.294818    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:15.308876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.294892    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:15.308876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.295699    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:15.308876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.306389    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:15.308876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.306434    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:15.563056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.562954    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:52:15.564184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.564160    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:52:15.653903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.636448    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:15.665978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.665940    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:15.674024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.673980    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:15.674270 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:15.674243    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:16.063864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.044368    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:16.215261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.211323    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 17:52:16.215261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.211394    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 17:52:16.268730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.268696    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 17:52:16.269031 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.269007    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 17:52:16.269613 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:52:16.269584    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:52:16.293531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.293499    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:52:16.451698 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.450459    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:52:16.562492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.562444    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 17:52:16.562770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.562737    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 17:52:16.635050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.635014    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 17:52:16.635318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:16.635290    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 17:52:17.212889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.212830    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:17.214244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.214220    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:17.215135 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.215115    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:52:17.263915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.263825    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:17.264509 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.264483    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:17.265333 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.265309    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:52:17.977037 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.977005    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:17.978269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.978247    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:17.979891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:17.979870    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:52:18.020826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:18.020801    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:18.021331 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:18.021308    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:18.022396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:18.022374    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 17:52:20.076877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:20.073244    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:20.577864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:20.577431    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:20.756870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:20.754415    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:20.850935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:20.847044    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:21.074642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:21.074570    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:52:21.076407 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:21.075411    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:52:21.245857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:21.226342    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:52:21.780997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:21.780912    5054 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:25.944501 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.944459    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 17:52:25.950354 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.950329    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:25.963490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.963460    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 02 17:52:25.963642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.963484    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 02 17:52:25.964065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.964045    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 02 17:52:25.964252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.964062    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d64z4\""
Nov 02 17:52:25.967440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:25.967417    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 17:52:26.026726 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.026689    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfqcz\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.026935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.026744    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.026935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.026894    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.027072 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.026936    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.027184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.027168    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.027243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.027195    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.027339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.027318    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.129337 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.129297    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfqcz\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.130563 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.130534    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.130664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.130632    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.130765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.130678    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.130930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.130913    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.131047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.131030    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.131118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.131100    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.133246 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.133189    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.143588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.143555    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.146369 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.146325    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.148269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.148134    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.148439 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.148414    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfqcz\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.149592 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.148667    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.149592 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.149394    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qbbh5\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.263033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.262951    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:26.558220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.558192    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 17:52:26.558626 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:52:26.558602    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69179cf_29b5_4af9_b8e0_c272d8f32e0e.slice/crio-70b823abd651755844e121a77a3bea178c0918ca72236a97f9d0be1eb5bdef04 WatchSource:0}: Error finding container 70b823abd651755844e121a77a3bea178c0918ca72236a97f9d0be1eb5bdef04: Status 404 returned error can't find the container with id 70b823abd651755844e121a77a3bea178c0918ca72236a97f9d0be1eb5bdef04
Nov 02 17:52:26.560817 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:26.560799    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 17:52:27.396576 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:27.396529    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" event={"ID":"c69179cf-29b5-4af9-b8e0-c272d8f32e0e","Type":"ContainerStarted","Data":"70b823abd651755844e121a77a3bea178c0918ca72236a97f9d0be1eb5bdef04"}
Nov 02 17:52:29.415176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:29.415136    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:52:29.567151 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:29.567113    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:29.567290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:29.567182    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:30.436937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.436885    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" event={"ID":"c69179cf-29b5-4af9-b8e0-c272d8f32e0e","Type":"ContainerStarted","Data":"ad4c252b62290fc88d29679159b696f7876ea53af28f8f33fcff854b76cd9910"}
Nov 02 17:52:30.446661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.440655    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:30.453857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.450162    5054 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-qbbh5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 17:52:30.453857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.450214    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:52:30.492939 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.488358    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" podStartSLOduration=2.483508261 podStartE2EDuration="5.488336603s" totalImagesPullingTime="3.004828342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:30.471478645 +0000 UTC m=+753.980240713" watchObservedRunningTime="2026-11-02 17:52:30.488336603 +0000 UTC m=+753.997098671"
Nov 02 17:52:30.872269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.872188    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:52:30.886336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:30.886305    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:52:31.464957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:31.464657    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 17:52:45.852436 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:52:45.852312    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:52:50.568004 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:50.567954    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:50.568995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:50.568964    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:52:50.730064 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:50.728919    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:50.843013 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:50.842899    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:52:52.386153 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.386119    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 17:52:52.391054 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.391031    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.435469 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.435427    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 17:52:52.510772 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.510739    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.510976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.510779    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.510976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.510960    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511113    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511174 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511155    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511240    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7tgw\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511272    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511341 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511296    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.511403 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.511390    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.605833 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.605796    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:52:52.610349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.610319    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.612221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612192    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612337 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612321    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612361    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612422 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612405    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7tgw\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612466 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612445    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612734    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612764    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612798    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.612874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612828    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.613050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612875    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.613050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.612795    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.613143 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.613064    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.613287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.613263    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.613539 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.613521    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.615356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.615333    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.615599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.615577    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.632302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.632239    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:52:52.634124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.634099    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7tgw\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.636546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.636498    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\") pod \"e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") " pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.711389 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.711359    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:52.713948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.713921    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714067 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.713999    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7mv\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714112    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714212    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714266 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714237    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714614 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714324    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714614 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714379    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714614 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714450    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.714614 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.714568    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.815693    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.815769    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.815868    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7mv\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.815929    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.816022    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.816048    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.816093    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.816161    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.816255    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.817102    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.817134    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.817413    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.817456    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.817666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.817619    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.819468 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.819396    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.820324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.820293    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.829305 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.829200    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7mv\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.830644 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.830617    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:52.980688 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:52.980656    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:53.005626 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:52:53.005596    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4357e330_23a7_4f00_94fe_36852eaabef5.slice/crio-8def584464073f6abc4e009d448fd2e64f819130ab4faa888b0cd5fb61ea69dc WatchSource:0}: Error finding container 8def584464073f6abc4e009d448fd2e64f819130ab4faa888b0cd5fb61ea69dc: Status 404 returned error can't find the container with id 8def584464073f6abc4e009d448fd2e64f819130ab4faa888b0cd5fb61ea69dc
Nov 02 17:52:53.006329 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.006304    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 17:52:53.008773 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.008742    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.008931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.008815    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.008931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.008878    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.279355 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:52:53.279325    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbb4cc1_cafa_414a_bdf4_1ff051b50fcc.slice/crio-1d7b03172a7d5444c672b24aea8dbf9bd46a570a2fb51dc41bcdc3db647c1fd1 WatchSource:0}: Error finding container 1d7b03172a7d5444c672b24aea8dbf9bd46a570a2fb51dc41bcdc3db647c1fd1: Status 404 returned error can't find the container with id 1d7b03172a7d5444c672b24aea8dbf9bd46a570a2fb51dc41bcdc3db647c1fd1
Nov 02 17:52:53.279869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.279809    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:52:53.282216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.282186    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.282303 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.282248    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.282303 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.282281    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:52:53.751491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.751454    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" event={"ID":"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc","Type":"ContainerStarted","Data":"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"}
Nov 02 17:52:53.752033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.751535    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" event={"ID":"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc","Type":"ContainerStarted","Data":"1d7b03172a7d5444c672b24aea8dbf9bd46a570a2fb51dc41bcdc3db647c1fd1"}
Nov 02 17:52:53.753548 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.753519    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" event={"ID":"4357e330-23a7-4f00-94fe-36852eaabef5","Type":"ContainerStarted","Data":"39ede66a7d41f426e2e351b34e3477a7dd91c98a23e674bb84f3ee67424b1a84"}
Nov 02 17:52:53.753699 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.753571    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" event={"ID":"4357e330-23a7-4f00-94fe-36852eaabef5","Type":"ContainerStarted","Data":"8def584464073f6abc4e009d448fd2e64f819130ab4faa888b0cd5fb61ea69dc"}
Nov 02 17:52:53.818730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.818677    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podStartSLOduration=1.8186614859999999 podStartE2EDuration="1.818661486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:53.816575211 +0000 UTC m=+777.325337279" watchObservedRunningTime="2026-11-02 17:52:53.818661486 +0000 UTC m=+777.327423555"
Nov 02 17:52:53.984862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:53.983286    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:52:54.721864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:54.718003    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:52:54.721864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:54.721440    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:54.721864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:54.721505    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:54.992070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:54.991958    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:54.992673 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:54.992641    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:52:55.719906 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:55.716251    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:55.719906 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:55.716329    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:55.990921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:55.990233    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:55.990921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:55.990311    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:52:56.713080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:56.712574    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:56.713080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:56.712638    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:56.984927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:56.983240    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:56.984927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:56.983316    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:52:57.715864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:57.712286    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:57.715864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:57.712368    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:57.994094 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:57.993986    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:58.016876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:58.000989    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:52:58.712305 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:58.712263    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:58.712626 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:58.712595    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:59.002238 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.002141    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:59.002880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.002828    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:52:59.712045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.712008    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Nov 02 17:52:59.712264 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.712083    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Nov 02 17:52:59.981271 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.981181    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 02 17:52:59.981423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:52:59.981261    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 02 17:53:00.731115 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:00.731080    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:53:00.732112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:00.732084    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:53:00.733056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:00.733035    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 17:53:00.782137 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:00.782074    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podStartSLOduration=8.782055508 podStartE2EDuration="8.782055508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:52:53.89308407 +0000 UTC m=+777.401846138" watchObservedRunningTime="2026-11-02 17:53:00.782055508 +0000 UTC m=+784.290817576"
Nov 02 17:53:01.050387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:01.050303    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:53:01.050650 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:01.050632    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:53:01.051394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:01.051375    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:53:06.120875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:06.120817    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:53:07.220999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.220963    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 17:53:07.288101 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.288066    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 17:53:07.296864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.288445    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.510918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.489513    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.511604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.511566    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrss7\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.511814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.511792    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.511990 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.511968    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.512158 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.512141    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.534680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.512474    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.534680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.533543    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.534680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.533618    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.534680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.533693    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.637564 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.637530    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:53:07.709450 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.709408    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.709748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.709723    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.709907 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.709881    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.710083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.710067    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.714397 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.714364    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.714575 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.714553    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrss7\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.714730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.714714    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.721630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.714865    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.722044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.722018    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.739888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.737474    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.739888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.738186    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.764908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.763707    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.764908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.764038    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.764908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.764610    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.796956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.796553    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrss7\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.853860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.818035    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.861864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.854652    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.905863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.882115    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:53:07.905863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.882176    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.905863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.882178    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\") pod \"e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") " pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:07.940215 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.940181    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.949219 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.949177    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.949599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.949580    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7k2n\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.949790 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.949777    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.949956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.949934    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.950140 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.950126    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.950277 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.950264    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.950400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.950387    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.950580 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.950559    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:07.964541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:07.964496    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:53:08.035909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.021182    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.059362 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.059322    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077262    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077314    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75cm9\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077346    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077373    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077403    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077430    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077505    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077549    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7k2n\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077613    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077659    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077697    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077750    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077784    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077816    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077862    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077895    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077953    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.077982    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.089871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.078671    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.117199 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.116127    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:08.117199 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.116723    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.131974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.122400    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.131974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.122626    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.131974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.123269    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.161224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.140477    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:53:08.161224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.140533    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:53:08.161224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.140634    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.161224 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.141874    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.165145 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.164567    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7k2n\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.197906 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.184382    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.222861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.208657    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\") pod \"e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") " pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.284859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.279341    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291203    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75cm9\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291276    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291318    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291352    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291454    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291617    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291691    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291732    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.291801    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.292477    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.304629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.292743    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.311914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.306100    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.311914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.308277    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.316909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.316861    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.378114 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.378036    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.380957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.380868    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75cm9\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.393235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.393195    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65pvx\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.393590 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.393525    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.393946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.393781    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.394110 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.394090    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.394304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.394287    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.394546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.394526    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.394899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.394879    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.395053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.395036    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.395214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.395199    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.396419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.396375    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.465873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.465148    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.498853    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.498908    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.498954    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499025    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499183    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499225    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499253    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499378    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65pvx\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499434    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.501878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.499948    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.517978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.514300    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.517978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.515019    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.517978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.515669    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.518563 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.518539    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.554156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.554114    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.574666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.573727    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65pvx\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.581672 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.575440    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.581672 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.575908    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\") pod \"e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") " pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.666870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.651314    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:08.771157 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.771115    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:08.884056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:08.882931    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:09.461941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.451060    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:09.589076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.585977    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:09.589076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.586387    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:09.753339 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.751985    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:09.886265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.886216    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:09.959473 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.904922    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:09.959473 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.931163    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:53:09.972889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:09.972853    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 17:53:10.165280 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.165229    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.196657 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.196609    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.196927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.196906    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.464562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.464481    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:10.468359 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.466890    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:10.478129 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.477461    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:53:10.493872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.492612    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:53:10.747861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.746922    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.747861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.747246    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.747861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.747496    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:10.949471 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.949435    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:10.949759 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:10.949728    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" event={"ID":"da3621a8-307a-44ec-ab7e-c7d6459c5e9d","Type":"ContainerStarted","Data":"5bb17cdfea005c0b791a7caf18bbe98c3880fa957c3ed12a721f5fe0f97c4400"}
Nov 02 17:53:11.177466 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.176884    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:53:11.191190 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:53:11.186773    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4b5792_7d1a_4d14_b033_3451de02b0d7.slice/crio-d2d2fe83ca2294dfb9ed6f36caaa5734b9deafbb0d38dc8d946c3b7ac121a63e WatchSource:0}: Error finding container d2d2fe83ca2294dfb9ed6f36caaa5734b9deafbb0d38dc8d946c3b7ac121a63e: Status 404 returned error can't find the container with id d2d2fe83ca2294dfb9ed6f36caaa5734b9deafbb0d38dc8d946c3b7ac121a63e
Nov 02 17:53:11.221373 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:53:11.221337    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e778a0_454f_4bca_8712_1dc540189897.slice/crio-ae1e998fde5bde53934906a8541d388ab9df4b9dc80d1b55ea91fe8509af1989 WatchSource:0}: Error finding container ae1e998fde5bde53934906a8541d388ab9df4b9dc80d1b55ea91fe8509af1989: Status 404 returned error can't find the container with id ae1e998fde5bde53934906a8541d388ab9df4b9dc80d1b55ea91fe8509af1989
Nov 02 17:53:11.222918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.222832    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.223049 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.222934    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.223049 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.222979    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.224406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.224383    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:53:11.225826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.225716    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.225826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.225800    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.226079 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.225979    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:11.953724 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.953682    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" event={"ID":"ad4b5792-7d1a-4d14-b033-3451de02b0d7","Type":"ContainerStarted","Data":"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"}
Nov 02 17:53:11.956034 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.955987    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" event={"ID":"ad4b5792-7d1a-4d14-b033-3451de02b0d7","Type":"ContainerStarted","Data":"d2d2fe83ca2294dfb9ed6f36caaa5734b9deafbb0d38dc8d946c3b7ac121a63e"}
Nov 02 17:53:11.961642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.961611    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" event={"ID":"da3621a8-307a-44ec-ab7e-c7d6459c5e9d","Type":"ContainerStarted","Data":"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"}
Nov 02 17:53:11.965714 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.965683    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" event={"ID":"64e778a0-454f-4bca-8712-1dc540189897","Type":"ContainerStarted","Data":"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"}
Nov 02 17:53:11.965939 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.965920    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" event={"ID":"64e778a0-454f-4bca-8712-1dc540189897","Type":"ContainerStarted","Data":"ae1e998fde5bde53934906a8541d388ab9df4b9dc80d1b55ea91fe8509af1989"}
Nov 02 17:53:11.969458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.969437    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" event={"ID":"fbdd5ce0-9640-4b71-be42-d7db9d3e9533","Type":"ContainerStarted","Data":"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"}
Nov 02 17:53:11.969770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:11.969748    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" event={"ID":"fbdd5ce0-9640-4b71-be42-d7db9d3e9533","Type":"ContainerStarted","Data":"26f599040d6c41226d4fdc10d9a1942989a56f54a48119096d301abbe3981553"}
Nov 02 17:53:12.148689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.148617    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podStartSLOduration=5.148592916 podStartE2EDuration="5.148592916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:12.116340919 +0000 UTC m=+795.625102988" watchObservedRunningTime="2026-11-02 17:53:12.148592916 +0000 UTC m=+795.657354984"
Nov 02 17:53:12.150544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.150491    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podStartSLOduration=5.150475374 podStartE2EDuration="5.150475374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:12.050222699 +0000 UTC m=+795.558984777" watchObservedRunningTime="2026-11-02 17:53:12.150475374 +0000 UTC m=+795.659237441"
Nov 02 17:53:12.151447 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.151422    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:12.154086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.154033    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:12.154269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.154243    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:12.165234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.165133    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podStartSLOduration=5.165115521 podStartE2EDuration="5.165115521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:12.161261928 +0000 UTC m=+795.670023996" watchObservedRunningTime="2026-11-02 17:53:12.165115521 +0000 UTC m=+795.673877589"
Nov 02 17:53:12.314288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.288619    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:12.316517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.316482    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:12.336194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.335955    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:12.660608 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.660520    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:12.667030 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.666987    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:12.779864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.764699    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:12.782784 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.782754    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:12.783702 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.783674    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:12.783912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:12.783887    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:13.141865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.140420    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:13.141865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.140480    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:13.300864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.291313    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:13.300864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.291380    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:13.574863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.574252    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:13.574863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.574665    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:13.645863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.645052    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:13.645863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.645116    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:13.773727 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.773277    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:13.773727 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:13.773339    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:14.133684 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.133646    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:14.133985 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.133957    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:14.287531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.287488    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:14.288149 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.288117    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:14.486863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.485905    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:14.582862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.582121    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:14.582862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.582550    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:14.586858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.583245    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:53:14.586858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.583309    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:53:14.640460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.639308    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:14.640460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.639368    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:14.660871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.654040    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podStartSLOduration=7.654020084 podStartE2EDuration="7.654020084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:12.26114238 +0000 UTC m=+795.769904448" watchObservedRunningTime="2026-11-02 17:53:14.654020084 +0000 UTC m=+798.162782152"
Nov 02 17:53:14.764921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.739663    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:14.774877 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.774820    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:14.775132 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.775102    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:14.845885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.844988    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:14.945908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:14.877552    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.260865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.242156    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:15.260865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.242215    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:15.310440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.310405    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:15.394000 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.326335    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.394580 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.394546    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:15.508865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.487116    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.508865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.489286    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:53:15.591157 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.591060    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.592140 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.591004    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.650077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.649592    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:15.650077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.649652    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:15.864069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.863971    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:15.864069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.864039    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:15.885891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.878211    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.885891 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.879579    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:15.931488 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.931444    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:15.936648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:15.936621    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:53:16.143443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.143144    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:16.143443 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.143202    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:16.327622 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:53:16.327585    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:53:16.364943 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.364910    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:16.365214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.365185    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:16.565863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.555507    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:16.592449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.592401    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:16.597953 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.597915    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:53:16.648864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.646240    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:16.648864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.646303    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:16.751696 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.751633    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:16.791868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.778680    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:16.791868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.778745    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:16.891047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.890938    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:53:16.940656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:16.939449    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:53:17.126862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.126249    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:17.126862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.126312    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:17.304862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.299375    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:17.304862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.299437    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:17.565086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.564980    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:17.593024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.592981    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:17.601999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.601925    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:17.643869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.643460    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:17.643869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.643519    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:17.769890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.758048    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:17.769890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.758742    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:53:17.775210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.775176    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:17.778938 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.778904    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:17.968988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.918943    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:53:17.969917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.948390    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:53:17.970436 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:17.970406    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:18.183873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.172567    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:18.184184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.184143    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:18.514868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.514012    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:18.514868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.514074    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:18.579879 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.551136    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:53:18.590872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.585970    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:18.596679 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.595916    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:18.610311 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.609919    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:18.642948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.642900    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:18.643230 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.643197    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:18.758981 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.758926    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:18.878911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.878749    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:18.911480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.895379    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:18.980710 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:18.969932    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:19.170910 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.166330    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:19.170910 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.166387    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:19.171170 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.171117    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:19.252652 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.252623    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:53:19.294852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.294791    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:19.295106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.295077    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:19.417986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.417935    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:19.695920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.631950    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:19.695920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.659902    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:19.799006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.798957    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:19.800568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.800534    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:19.800736 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.800716    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:19.806234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.806208    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:19.806395 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:19.806371    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:20.134194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.134106    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:20.134435 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.134404    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:20.160983 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.160941    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:53:20.170876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.169456    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:53:20.346221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.346181    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Nov 02 17:53:20.346491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.346458    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Nov 02 17:53:20.364544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.364512    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:53:20.652486 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.652446    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:20.653073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.653033    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:20.772168 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.772132    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 02 17:53:20.772770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:20.772734    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 02 17:53:21.125138 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.125098    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 02 17:53:21.125426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.125393    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 02 17:53:21.501859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.495232    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:21.501859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.496300    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:21.524863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.524031    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:53:21.658892 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.652219    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Nov 02 17:53:21.658892 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.652279    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Nov 02 17:53:21.810599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.810518    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:21.812972 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.812952    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:21.823128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:21.823100    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:53:22.313478 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.313436    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:22.314180 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.314125    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:22.319982 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.319954    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 17:53:22.364888 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.364522    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:53:22.371532 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.371363    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.405525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.405497    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:53:22.546194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546155    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546227    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546356    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546523 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546400    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546585 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546569    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546638    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9x8\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546685    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546779 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546732    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.546779 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.546762    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.642822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.642742    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:22.643189 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.643169    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:22.643827 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.643803    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:53:22.648007 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.647981    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648048    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br9x8\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648085    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648127    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648157    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648271    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648424 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648319    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648444    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648501    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648600 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648549    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648708    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648834 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648811    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.648999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.648980    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.649513 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.649494    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.651044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.651022    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.651398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.651381    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.658021 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.657990    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.658155 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.658137    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9x8\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\") pod \"e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") " pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.689920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.689895    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:53:22.695237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.695217    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.725556 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.725520    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:22.732921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.732884    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:53:22.749768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749716    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.749956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749785    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.749956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749826    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.749956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749878    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.749956 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749934    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfmkt\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.750269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.749980    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.750269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.750098    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.750269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.750148    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.750465 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.750315    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851195    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851240    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851265    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851299    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfmkt\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851332    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851403    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.851433    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.852017    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.852615    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.853186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.852934    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.854016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.853355    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.854077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.854021    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.854275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.854253    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.854360 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.854325    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.855448 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.855417    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.856829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.856787    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.861556 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.861522    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:22.864711 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:22.864677    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfmkt\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\") pod \"e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") " pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:23.025826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.025787    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:23.053188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.053158    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:53:23.053638 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:53:23.053601    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c94d44_38ea_45da_b096_667b62bf9f35.slice/crio-6be946a21cbd6e23aa55fb8523669d7912e13d3c8bf0bb2899d5df8233ef7b1f WatchSource:0}: Error finding container 6be946a21cbd6e23aa55fb8523669d7912e13d3c8bf0bb2899d5df8233ef7b1f: Status 404 returned error can't find the container with id 6be946a21cbd6e23aa55fb8523669d7912e13d3c8bf0bb2899d5df8233ef7b1f
Nov 02 17:53:23.056596 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.056552    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.056683 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.056653    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.056729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.056700    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.306770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.306688    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" event={"ID":"39c94d44-38ea-45da-b096-667b62bf9f35","Type":"ContainerStarted","Data":"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"}
Nov 02 17:53:23.307040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.307016    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" event={"ID":"39c94d44-38ea-45da-b096-667b62bf9f35","Type":"ContainerStarted","Data":"6be946a21cbd6e23aa55fb8523669d7912e13d3c8bf0bb2899d5df8233ef7b1f"}
Nov 02 17:53:23.350636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.346993    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:53:23.353948 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.353451    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podStartSLOduration=1.353434394 podStartE2EDuration="1.353434394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:23.334000867 +0000 UTC m=+806.842762981" watchObservedRunningTime="2026-11-02 17:53:23.353434394 +0000 UTC m=+806.862196462"
Nov 02 17:53:23.361340 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:53:23.361301    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6b1fb8_4e62_46f4_982f_fe179c62bea1.slice/crio-02b7890a96d9704eb2a95c9b07eab04de533bd8ec26c26baf606c6ecc2fdfb83 WatchSource:0}: Error finding container 02b7890a96d9704eb2a95c9b07eab04de533bd8ec26c26baf606c6ecc2fdfb83: Status 404 returned error can't find the container with id 02b7890a96d9704eb2a95c9b07eab04de533bd8ec26c26baf606c6ecc2fdfb83
Nov 02 17:53:23.364324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.364281    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.364450 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.364375    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.364450 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.364415    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:53:23.727163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:23.727125    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:24.341828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:24.341790    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" event={"ID":"9f6b1fb8-4e62-46f4-982f-fe179c62bea1","Type":"ContainerStarted","Data":"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"}
Nov 02 17:53:24.341828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:24.341872    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" event={"ID":"9f6b1fb8-4e62-46f4-982f-fe179c62bea1","Type":"ContainerStarted","Data":"02b7890a96d9704eb2a95c9b07eab04de533bd8ec26c26baf606c6ecc2fdfb83"}
Nov 02 17:53:24.728188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:24.728153    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:24.728363 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:24.728200    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:25.026080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:25.025988    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:25.027756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:25.027726    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:25.027873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:25.027783    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:25.729054 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:25.729000    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:25.729572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:25.729068    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:26.027915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:26.027224    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:26.027915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:26.027286    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:26.727533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:26.727499    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:26.727822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:26.727795    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:27.029918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:27.029245    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:27.029918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:27.029306    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:27.732556 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:27.732197    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:27.732556 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:27.732246    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:28.033914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:28.030202    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:28.033914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:28.030262    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:28.730300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:28.730261    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:28.730608 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:28.730581    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:29.035930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:29.034980    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:29.035930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:29.035045    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:29.727642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:29.727612    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Nov 02 17:53:29.727912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:29.727882    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Nov 02 17:53:30.026722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:30.026621    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 02 17:53:30.026722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:30.026685    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 02 17:53:31.099202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.099171    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:31.100506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.100442    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:31.105624 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.105536    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:53:31.138864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.138772    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podStartSLOduration=9.138755769 podStartE2EDuration="9.138755769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:53:24.383964904 +0000 UTC m=+807.892726977" watchObservedRunningTime="2026-11-02 17:53:31.138755769 +0000 UTC m=+814.647517837"
Nov 02 17:53:31.370588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.370501    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:31.371152 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.371125    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:31.371976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:31.371958    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:53:39.617792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:39.617750    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:39.808002 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:39.807671    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:40.608862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.608123    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:53:40.609077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.608963    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:40.670871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.619279    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:40.830873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.830281    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:40.900163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.889071    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:53:40.900163 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.889140    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:53:40.957320 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:40.957264    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:41.010864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.007291    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:41.781870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.720060    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:41.781870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.725928    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:41.781870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.726215    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:53:41.781870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.726219    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:41.781870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.727507    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:53:41.914861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.914097    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": context deadline exceeded"
Nov 02 17:53:41.914861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:41.914225    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:42.299052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.298992    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:42.324908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.315187    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:53:42.678923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.578678    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:53:42.711209 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.711178    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:43.050920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.780122    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:53:43.050920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.794987    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:43.050920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.795044    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:43.105057 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.869775    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:43.105259 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:42.933783    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Nov 02 17:53:43.274869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:43.256664    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:43.327900 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:43.318222    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:43.542862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:43.519795    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:43.622089 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:43.621978    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:43.622388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:43.622339    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.048943 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.048900    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.049525 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.049493    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.084216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.083348    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.271889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.258921    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:44.319716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.318484    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.528935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.521407    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:44.537009 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.536963    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:44.537313 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:44.537283    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:45.071860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.051127    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:45.134187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.086965    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:53:45.135503 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.087045    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:45.260652 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.260608    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:45.266169 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.266130    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:45.336916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.333997    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:45.526015 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:45.525966    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.126860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.121952    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:46.208865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.166940    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.208865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.167406    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:53:46.276277 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.276230    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.325972 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.325930    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:46.326250 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.326218    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.326400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.326374    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:46.326479 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.326431    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.346871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.338350    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:53:46.372104 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:53:46.372057    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:53:46.557037 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.539326    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:53:46.816458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.815932    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:46.816458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.816017    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:46.937864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.920088    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:46.938202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:46.938167    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.133074 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.132969    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:47.133620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.133320    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.133964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.133936    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.158392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.158356    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:47.158691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.158647    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.173446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.173400    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.203164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.174894    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:53:47.288865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.279991    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:47.356996 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.356946    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:47.638908 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:47.611434    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:53:48.165862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.154023    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.277863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.195476    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:53:48.398864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.302956    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:53:48.458107 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.303507    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:48.458563 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.458362    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.532502 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.332577    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.542073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.375284    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.542361 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.332038    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.542467 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.366559    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:48.567976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.546423    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:48.648863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:48.631145    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:49.319969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.319930    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:53:49.320271 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.320238    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:49.368459 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.368418    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": context deadline exceeded"
Nov 02 17:53:49.375988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.375960    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:53:49.393317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.385871    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:49.440999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.440968    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:53:49.456826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.456798    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:53:49.544176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.544135    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:49.545667 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.545636    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:53:49.567046 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.567024    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:53:49.575221 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.575110    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:53:49.578365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:53:49.577541    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:54:09.255288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:09.255178    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:54:12.053977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.053925    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:12.055635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.055602    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:12.106991 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.106945    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:12.265019 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.264969    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:12.353916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.347979    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:12.353916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.348925    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:12.535411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.535362    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:54:12.663047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:12.663002    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Nov 02 17:54:13.065074 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.064970    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:13.108890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.092058    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:54:13.109314 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.109269    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:13.122356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.122314    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:54:13.137890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.065624    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:13.138304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.138282    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:54:13.364928 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.287498    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:13.596944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.541761    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:54:13.603647 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.360225    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:13.624636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.613446    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:54:13.624636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.614976    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:13.626959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:13.626931    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:54:14.102829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.102777    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:14.138540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.138497    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:14.168865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.154056    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:14.596865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.544614    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:14.604957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.604913    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:14.628916 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:14.628872    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:15.105978 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.105929    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:15.165870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.159930    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:15.203976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.203925    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:15.426923 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.425418    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:15.616865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.609171    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:15.616865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.610156    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:15.658863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:15.642927    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.151865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.150871    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:16.167974 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.167926    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:16.209864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.209122    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.275801 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.275756    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:16.277658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.276076    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.296616 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.296346    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:16.296616 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.296405    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.628864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.621034    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.668981 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.668932    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:54:16.739493 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.739448    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:16.755930 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:16.740185    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:54:16.921050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.921013    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:16.973692 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:16.951861    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:17.159219 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.158621    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:17.273336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.270746    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:17.273336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.270827    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:17.291872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.283582    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:17.296027 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.295984    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:17.662635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.662591    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:17.699966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.699919    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:17.747010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.746957    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:17.787868 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:17.773112    5054 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.133s"
Nov 02 17:54:17.968929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:17.963603    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:18.680288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.680258    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:54:18.685997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.685001    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:54:18.690857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.690073    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:54:18.690857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.690125    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:54:18.697851 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.691966    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:54:18.716873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:18.715598    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:54:41.113866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.110952    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:41.177905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.172940    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:41.220869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.220693    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:41.621032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.620972    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:41.646607 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.646562    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:41.659975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.659929    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:41.772594 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:41.772536    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.202865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.149828    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.202865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.150173    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:54:42.202865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.177264    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.202865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.177771    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:54:42.249091 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.222504    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.249091 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.229737    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:54:42.338861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.337038    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.644958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.636267    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:42.806743 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.784503    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:54:42.864865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.844211    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:43.024864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:42.974935    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:54:43.159770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.159725    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:43.261894 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.221284    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:43.299437 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.261498    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:43.654016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.641445    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:43.654016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.641533    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:43.839075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.839023    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:43.896862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.893226    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:43.904560 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:43.904473    5054 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.268s"
Nov 02 17:54:43.904817 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.904799    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:54:43.905008 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.904993    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:54:43.905237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:43.905222    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:54:44.030945 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.030888    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:54:44.198865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.190500    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:44.389865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.357175    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:44.471568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.390984    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:44.519968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.519906    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:44.520284 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.520240    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:44.844337 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.841943    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:54:44.897371 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:44.896994    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:45.042824 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.042369    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:54:45.194862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.193922    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:45.437055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.436923    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded"
Nov 02 17:54:45.493922 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.485918    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:45.527870 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.523948    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:45.845048 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.843977    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:45.903014 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:45.902967    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:46.058887 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.045923    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:46.238118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.238066    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:46.279862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.273944    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:46.279862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.274029    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:46.359866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.312540    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:46.359866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.312755    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:46.428863 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:46.421726    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:54:46.489258 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.489149    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:46.577864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:46.568711    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:47.034901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.009788    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.062872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.041987    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:54:47.064764 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.064708    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.140782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.140739    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.141111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.141078    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.210170 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.210132    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.210479 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.210452    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.482027 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.481984    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.499153 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.499092    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.518024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.517988    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.521862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.516989    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.534121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.516970    5054 patch_prober.go:29] interesting pod/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.534419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.534389    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.534555 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.534004    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:47.557871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.533940    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:54:47.618864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.604147    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:47.656864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.641040    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:47.825562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:47.752855    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:48.054960 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.054894    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.075441 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.075398    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.078263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.077755    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.102392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.098951    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.315035 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.314984    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:48.315331 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.315284    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.538094 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.538053    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:48.658530 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.657960    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.668861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.664922    5054 patch_prober.go:29] interesting pod/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:48.668861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.664985    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:48.793031 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:48.792926    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:54:49.170144 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.167080    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.170144 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.167375    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.236334 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.200106    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:54:49.236334 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.223648    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:49.236334 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.223709    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.373905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.369960    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:49.374236 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.374187    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.509922 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.478169    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.662981 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.662936    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:54:49.687915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.683223    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.687915 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:49.684613    5054 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.041s"
Nov 02 17:54:49.687915 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.684695    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-b76500"]
Nov 02 17:54:49.740856 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.736942    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:54:49.740856 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.736985    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-b76500"]
Nov 02 17:54:49.740856 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.738387    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:49.745865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.744640    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 02 17:54:49.745865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.744747    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 02 17:54:49.746324 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.746260    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pqt9j\""
Nov 02 17:54:49.794802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.791301    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:54:49.796068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.796040    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zhv\" (UniqueName: \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\") pod \"test-curl-7719-b76500\" (UID: \"df381c39-4449-48f3-b2d4-5deba28e3161\") " pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:49.828623 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.826149    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:54:49.839260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.839182    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:54:49.839782 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.839459    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:54:49.903014 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.902986    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:54:49.966176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.966147    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:54:49.967016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:49.966990    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:54:50.015045 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:50.015002    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zhv\" (UniqueName: \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\") pod \"test-curl-7719-b76500\" (UID: \"df381c39-4449-48f3-b2d4-5deba28e3161\") " pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:50.049100 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:50.049018    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zhv\" (UniqueName: \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\") pod \"test-curl-7719-b76500\" (UID: \"df381c39-4449-48f3-b2d4-5deba28e3161\") " pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:50.087234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:50.087196    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:50.404370 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:54:50.404337    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf381c39_4449_48f3_b2d4_5deba28e3161.slice/crio-b041e0bab15f167888132b9e697dbf294f832f49557e10f824e07ac91a93eb54 WatchSource:0}: Error finding container b041e0bab15f167888132b9e697dbf294f832f49557e10f824e07ac91a93eb54: Status 404 returned error can't find the container with id b041e0bab15f167888132b9e697dbf294f832f49557e10f824e07ac91a93eb54
Nov 02 17:54:50.404678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:50.404654    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-b76500"]
Nov 02 17:54:50.735559 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:50.735522    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-b76500" event={"ID":"df381c39-4449-48f3-b2d4-5deba28e3161","Type":"ContainerStarted","Data":"b041e0bab15f167888132b9e697dbf294f832f49557e10f824e07ac91a93eb54"}
Nov 02 17:54:53.601191 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.601149    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:54:53.629555 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.629517    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:54:53.629746 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.629558    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.645312 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.645289    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-be1b0f58-gw-openshift-default-dockercfg-rqf98\""
Nov 02 17:54:53.848863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.845757    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.848863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.845822    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.848863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.846004    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.861562    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgb4b\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.861735    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.868398    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.868474    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.868559    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.872929 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.868654    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.918290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.918239    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-b76500" event={"ID":"df381c39-4449-48f3-b2d4-5deba28e3161","Type":"ContainerStarted","Data":"41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575"}
Nov 02 17:54:53.945052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.944980    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7719-b76500" podStartSLOduration=3.357176483 podStartE2EDuration="5.944961141s" totalImagesPullingTime="2.587784658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:54:53.937208554 +0000 UTC m=+897.445970623" watchObservedRunningTime="2026-11-02 17:54:53.944961141 +0000 UTC m=+897.453723210"
Nov 02 17:54:53.970112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970075    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970182    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970240    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970304    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970375    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970481    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970553 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970515    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970562    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.970716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.970599    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgb4b\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.971538 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.971299    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.972105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.971724    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.972105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.971974    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.972105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.972059    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.972762 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.972737    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.977397 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.977373    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.980700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.980673    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.985693 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.985670    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:53.987889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:53.987776    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgb4b\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\") pod \"e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") " pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:54.247294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.247261    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:54.622203 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:54:54.617695    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb608ed4_e6b7_45b4_8480_d9bcc011bcec.slice/crio-f71e2b3a98cb60d29b194d61bd8e26863741377033f4b377abf19e252e5e7437 WatchSource:0}: Error finding container f71e2b3a98cb60d29b194d61bd8e26863741377033f4b377abf19e252e5e7437: Status 404 returned error can't find the container with id f71e2b3a98cb60d29b194d61bd8e26863741377033f4b377abf19e252e5e7437
Nov 02 17:54:54.626468 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.626425    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:54:54.626591 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.626520    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:54:54.626591 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.626573    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:54:54.655893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.655860    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:54:54.665997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.665972    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-b76500"]
Nov 02 17:54:54.673660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.671825    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-b76500"]
Nov 02 17:54:54.930849 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.930806    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" event={"ID":"fb608ed4-e6b7-45b4-8480-d9bcc011bcec","Type":"ContainerStarted","Data":"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"}
Nov 02 17:54:54.931027 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.930920    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" event={"ID":"fb608ed4-e6b7-45b4-8480-d9bcc011bcec","Type":"ContainerStarted","Data":"f71e2b3a98cb60d29b194d61bd8e26863741377033f4b377abf19e252e5e7437"}
Nov 02 17:54:54.957377 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:54.957285    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" podStartSLOduration=1.9572652449999999 podStartE2EDuration="1.957265245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:54:54.952439566 +0000 UTC m=+898.461201634" watchObservedRunningTime="2026-11-02 17:54:54.957265245 +0000 UTC m=+898.466027312"
Nov 02 17:54:55.249300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:55.249212    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:55.255071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:55.255043    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:55.939210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:55.939172    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7719-b76500" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" containerName="test-curl-7719-b76500" containerID="cri-o://41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575" gracePeriod=2
Nov 02 17:54:55.939719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:55.939469    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:55.940377 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:55.940357    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:54:55.942126 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:55.942099    5054 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7719-b76500\" is forbidden: User \"system:node:ip-10-0-132-5.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-5.us-east-2.compute.internal' and this object" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:55.944443 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:55.944421    5054 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7719-b76500\" is forbidden: User \"system:node:ip-10-0-132-5.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-5.us-east-2.compute.internal' and this object" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:56.617595 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:56.617556    5054 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7719-b76500\" is forbidden: User \"system:node:ip-10-0-132-5.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-5.us-east-2.compute.internal' and this object" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:56.795689 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:56.795658    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:54:56.799533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:56.799509    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:54:56.801326 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:56.801304    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:54:56.804696 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:56.804673    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:54:58.237180 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:58.237148    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:58.375784 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:58.373444    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\" (UniqueName: \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\") pod \"df381c39-4449-48f3-b2d4-5deba28e3161\" (UID: \"df381c39-4449-48f3-b2d4-5deba28e3161\") "
Nov 02 17:54:58.393458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:58.391914    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv" pod "df381c39-4449-48f3-b2d4-5deba28e3161" (UID: "df381c39-4449-48f3-b2d4-5deba28e3161"). InnerVolumeSpecName "kube-api-access-t5zhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:54:58.483260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:58.483165    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5zhv\" (UniqueName: \"kubernetes.io/projected/df381c39-4449-48f3-b2d4-5deba28e3161-kube-api-access-t5zhv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:54:58.619419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:58.619384    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" path="/var/lib/kubelet/pods/df381c39-4449-48f3-b2d4-5deba28e3161/volumes"
Nov 02 17:54:59.023120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:59.023068    5054 generic.go:356] "Generic (PLEG): container finished" podID="df381c39-4449-48f3-b2d4-5deba28e3161" containerID="41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575" exitCode=137
Nov 02 17:54:59.023291 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:59.023200    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-b76500"
Nov 02 17:54:59.023291 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:59.023232    5054 scope.go:122] "RemoveContainer" containerID="41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575"
Nov 02 17:54:59.034980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:59.034951    5054 scope.go:122] "RemoveContainer" containerID="41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575"
Nov 02 17:54:59.035284 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:54:59.035263    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575\": container with ID starting with 41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575 not found: ID does not exist" containerID="41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575"
Nov 02 17:54:59.035367 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:54:59.035290    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575"} err="failed to get container status \"41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575\": rpc error: code = NotFound desc = could not find container \"41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575\": container with ID starting with 41f44b9d24f1b25b248886d0acad7e50169542dc6ffe56037a9a25bb8b489575 not found: ID does not exist"
Nov 02 17:55:00.701296 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.701258    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:55:00.702504 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.702475    5054 cpu_manager.go:414] "containerMap: removing container" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" containerName="test-curl-7719-b76500"
Nov 02 17:55:00.702504 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.702504    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" containerName="test-curl-7719-b76500"
Nov 02 17:55:00.702712 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.702697    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="df381c39-4449-48f3-b2d4-5deba28e3161" containerName="test-curl-7719-b76500"
Nov 02 17:55:00.708560 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.708492    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.726158 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.726128    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-51cd4868-openshift-default-dockercfg-2xz46\""
Nov 02 17:55:00.730551 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.730522    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.856973    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwct\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.857038    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.857198    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.857337    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.862371    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.862455    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.862526    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.862555    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.872857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.862632    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.968123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.968018    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.976413 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.976378    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.988008 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.987979    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.988574 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.988555    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.989032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.989017    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:00.989559 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.989542    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwct\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.006323 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.006292    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.006673 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.006652    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.006920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.006901    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.007787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.007609    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.007787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.988505    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.007787 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:00.988932    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.008375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.008329    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.009136 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.009065    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.040768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.030969    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.040768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.040571    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwct\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.049860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.041162    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.049860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.041648    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\") pod \"e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") " pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.328653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.328566    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:01.707722 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:55:01.707694    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47537ac1_a6e7_4348_aa89_679f6549726e.slice/crio-01aa3e82d605471507d3242157fe0863c83de29f988dd5427bbe6c3d5e9d1139 WatchSource:0}: Error finding container 01aa3e82d605471507d3242157fe0863c83de29f988dd5427bbe6c3d5e9d1139: Status 404 returned error can't find the container with id 01aa3e82d605471507d3242157fe0863c83de29f988dd5427bbe6c3d5e9d1139
Nov 02 17:55:01.708102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.708081    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:55:01.710548 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.710514    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:01.710655 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.710579    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:01.710655 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:01.710610    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:02.084480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:02.084388    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" event={"ID":"47537ac1-a6e7-4348-aa89-679f6549726e","Type":"ContainerStarted","Data":"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"}
Nov 02 17:55:02.084662 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:02.084494    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" event={"ID":"47537ac1-a6e7-4348-aa89-679f6549726e","Type":"ContainerStarted","Data":"01aa3e82d605471507d3242157fe0863c83de29f988dd5427bbe6c3d5e9d1139"}
Nov 02 17:55:02.110724 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:02.110667    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" podStartSLOduration=2.11065421 podStartE2EDuration="2.11065421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:02.108457635 +0000 UTC m=+905.617219703" watchObservedRunningTime="2026-11-02 17:55:02.11065421 +0000 UTC m=+905.619416364"
Nov 02 17:55:02.332090 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:02.331238    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:02.340557 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:02.340460    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:03.093667 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:03.093633    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:03.094756 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:03.094735    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:55:04.906169 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:04.906132    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:04.912821 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:04.912796    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:04.928958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:04.928931    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-be1b0f58-serving-cert\""
Nov 02 17:55:04.930332 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:04.930307    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:05.007029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.006984    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.007252 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.007231    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.007400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.007385    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.007477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.007461    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cbz\" (UniqueName: \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.155631    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.155727    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cbz\" (UniqueName: \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:05.155939    5054 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-serving-cert: secret "maas-api-e2e-migrate-be1b0f58-serving-cert" not found
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.155946    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:05.156030    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls podName:76d3ff8f-60e8-408d-b497-f70704167445 nodeName:}" failed. No retries permitted until 2026-11-02 17:55:05.656006535 +0000 UTC m=+909.164768600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls") pod "maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" (UID: "76d3ff8f-60e8-408d-b497-f70704167445") : secret "maas-api-e2e-migrate-be1b0f58-serving-cert" not found
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.156163    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.159490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.156762    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.163975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.163526    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.171055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.171028    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cbz\" (UniqueName: \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.669969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.669928    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.685678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.685635    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") pod \"maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:05.852065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:05.852028    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:06.464061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:06.464029    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:07.480423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.480383    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" event={"ID":"76d3ff8f-60e8-408d-b497-f70704167445","Type":"ContainerStarted","Data":"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"}
Nov 02 17:55:07.480935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.480444    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" event={"ID":"76d3ff8f-60e8-408d-b497-f70704167445","Type":"ContainerStarted","Data":"0de2603215298f7f66475ad295b6e90f410fb8eb2c1f1d9fd8bd990916ddf6ff"}
Nov 02 17:55:07.480935 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.480476    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:07.507718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.507651    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" podStartSLOduration=2.999262119 podStartE2EDuration="3.507632505s" totalImagesPullingTime="508.370386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:07.502053347 +0000 UTC m=+911.010815415" watchObservedRunningTime="2026-11-02 17:55:07.507632505 +0000 UTC m=+911.016394573"
Nov 02 17:55:07.900771 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.900684    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:07.920970 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.920632    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:07.922338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.922318    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:07.931607 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:07.931577    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d59fa283-serving-cert\""
Nov 02 17:55:08.085860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.080679    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.085860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.080749    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pwv\" (UniqueName: \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.085860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.080971    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.085860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.081133    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.183105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.183067    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.183330 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.183189    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.183420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.183404    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.183480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.183454    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pwv\" (UniqueName: \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.184040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.184005    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.185749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.185716    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.186027 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.186007    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.192601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.192574    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pwv\" (UniqueName: \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\") pod \"maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.247691 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.247656    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:08.653162 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.653131    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:08.653666 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:08.653182    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" event={"ID":"8eba29aa-66ae-4fcb-b36c-48e74e0d7898","Type":"ContainerStarted","Data":"17970744c839d06533d110bd881dc357a92cec7920644c6a727a210cfb84702f"}
Nov 02 17:55:09.654900 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:09.654797    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" event={"ID":"8eba29aa-66ae-4fcb-b36c-48e74e0d7898","Type":"ContainerStarted","Data":"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"}
Nov 02 17:55:09.655298 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:09.654968    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:09.677917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:09.677821    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" podStartSLOduration=1.946696325 podStartE2EDuration="2.67780745s" totalImagesPullingTime="731.111125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:09.673697032 +0000 UTC m=+913.182459103" watchObservedRunningTime="2026-11-02 17:55:09.67780745 +0000 UTC m=+913.186569516"
Nov 02 17:55:12.005867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.005819    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:12.011567 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.011542    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.028572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.027937    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-51cd4868-serving-cert\""
Nov 02 17:55:12.028572 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.028456    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:12.145862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.126783    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.145862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.126903    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.145862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.127306    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcfp\" (UniqueName: \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.145862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.127392    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.230311 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.230267    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcfp\" (UniqueName: \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.230510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.230363    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.230510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.230459    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.230635 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.230523    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.241562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.239103    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.241562 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.240812    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.244741 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.243974    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.247806 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.247776    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcfp\" (UniqueName: \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\") pod \"maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.352264 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.352166    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:12.876347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.876307    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:12.877088 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:55:12.877056    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf28bab_5eed_4ba1_ae9f_96d1235f6bec.slice/crio-6a0ea6b3fe9feadbdbca140bb8fc5683669264884f5696f3aa3a4f0657517de8 WatchSource:0}: Error finding container 6a0ea6b3fe9feadbdbca140bb8fc5683669264884f5696f3aa3a4f0657517de8: Status 404 returned error can't find the container with id 6a0ea6b3fe9feadbdbca140bb8fc5683669264884f5696f3aa3a4f0657517de8
Nov 02 17:55:12.959168 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:12.959131    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:55:13.731233 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:13.730233    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:13.876913 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:13.872658    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" event={"ID":"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec","Type":"ContainerStarted","Data":"6a0ea6b3fe9feadbdbca140bb8fc5683669264884f5696f3aa3a4f0657517de8"}
Nov 02 17:55:15.061427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:15.058794    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" event={"ID":"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec","Type":"ContainerStarted","Data":"6179d8148e981d1c958a896f3a7954ba72f7dce0b8f94104763302bf13e51535"}
Nov 02 17:55:15.061427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:15.059991    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:15.114121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:15.114063    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" podStartSLOduration=3.217783432 podStartE2EDuration="4.113820317s" totalImagesPullingTime="896.036885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:15.107588667 +0000 UTC m=+918.616350735" watchObservedRunningTime="2026-11-02 17:55:15.113820317 +0000 UTC m=+918.622582387"
Nov 02 17:55:15.692072 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:15.692016    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:16.281858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:16.271337    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:55:16.684864 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:16.684327    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:55:16.845984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:16.845938    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:17.234091 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.234036    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:17.251866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.234334    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:55:17.295970 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.295923    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:17.319330 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.297046    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:17.332571 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.332076    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:55:17.353119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.352276    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:55:17.877878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.863274    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:17.877878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:17.863891    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:55:18.023865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.016517    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:18.373608 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.373558    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:18.399864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.374572    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:55:18.687903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.450617    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:55:18.934386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.452223    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:55:18.934386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.818332    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:55:18.934386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.893162    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:18.934386 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.519588    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:19.031880 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:18.519857    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:55:19.203186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.203145    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:55:19.347928 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.341527    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:19.437865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.232336    5054 patch_prober.go:29] interesting pod/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:55:19.438520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.438477    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:19.442860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.409450    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": context deadline exceeded"
Nov 02 17:55:19.525078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.408521    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:55:19.704864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.702092    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:55:19.845967 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.822010    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:19.927874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.913923    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:19.927874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:19.914677    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:55:20.597883 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.587403    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:20.597883 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.587865    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:55:20.597883 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.588165    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-659wp" podUID="92e662d8-2058-4913-b42e-79039cb95b49" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded"
Nov 02 17:55:20.620532 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.620445    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:55:20.620760 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.620539    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:20.732520 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.732457    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:55:20.820111 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:20.806145    5054 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.988s"
Nov 02 17:55:20.820111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.806262    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:55:20.848009 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.837752    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:20.873393 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.873355    5054 patch_prober.go:29] interesting pod/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:55:20.873758 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.873632    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:20.923767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.923625    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:55:20.941664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:20.940586    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:55:21.556264 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.556228    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:55:21.591965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.591915    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:21.592245 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.592200    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:21.744022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.743972    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:55:21.797320 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.780450    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:21.841924 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.838421    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Nov 02 17:55:21.931541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.930936    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:21.950866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:21.946940    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.421873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.415448    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.617423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.617373    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:55:22.650972 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.650931    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:55:22.651249 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.651217    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.651668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.651638    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.667006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.666975    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.693699 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.693617    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:22.812293 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.811090    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.939455 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.939407    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.963177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.963013    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:22.966726 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:22.966659    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:23.312222 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.311741    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:55:23.312863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.312593    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:55:23.318931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.318014    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:55:23.338862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.334363    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:55:23.446119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.446086    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:55:23.456528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:23.448733    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:55:29.212766 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:29.212693    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:55:42.527043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:42.526758    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:42.527639 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:42.527479    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" podUID="76d3ff8f-60e8-408d-b497-f70704167445" containerName="maas-api" containerID="cri-o://384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7" gracePeriod=30
Nov 02 17:55:42.995007 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:42.994969    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:55:42.995467 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:42.995415    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" podUID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" containerName="istio-proxy" containerID="cri-o://cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7" gracePeriod=30
Nov 02 17:55:43.079015 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.078959    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:43.225918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.223986    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\" (UniqueName: \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\") pod \"76d3ff8f-60e8-408d-b497-f70704167445\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") "
Nov 02 17:55:43.225918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.224050    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\") pod \"76d3ff8f-60e8-408d-b497-f70704167445\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") "
Nov 02 17:55:43.225918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.224331    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") pod \"76d3ff8f-60e8-408d-b497-f70704167445\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") "
Nov 02 17:55:43.225918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.224565    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\") pod \"76d3ff8f-60e8-408d-b497-f70704167445\" (UID: \"76d3ff8f-60e8-408d-b497-f70704167445\") "
Nov 02 17:55:43.293054 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.292992    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca" pod "76d3ff8f-60e8-408d-b497-f70704167445" (UID: "76d3ff8f-60e8-408d-b497-f70704167445"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:55:43.373393 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.373359    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d3ff8f-60e8-408d-b497-f70704167445-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:43.404619 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.404170    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls" pod "76d3ff8f-60e8-408d-b497-f70704167445" (UID: "76d3ff8f-60e8-408d-b497-f70704167445"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:43.407083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.407017    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz" pod "76d3ff8f-60e8-408d-b497-f70704167445" (UID: "76d3ff8f-60e8-408d-b497-f70704167445"). InnerVolumeSpecName "kube-api-access-42cbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:43.419966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.419932    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs" pod "76d3ff8f-60e8-408d-b497-f70704167445" (UID: "76d3ff8f-60e8-408d-b497-f70704167445"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:43.478047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.476171    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:43.478286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.478268    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d3ff8f-60e8-408d-b497-f70704167445-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:43.478391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.478377    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42cbz\" (UniqueName: \"kubernetes.io/projected/76d3ff8f-60e8-408d-b497-f70704167445-kube-api-access-42cbz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:43.760947 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.760861    5054 generic.go:356] "Generic (PLEG): container finished" podID="76d3ff8f-60e8-408d-b497-f70704167445" containerID="384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7" exitCode=0
Nov 02 17:55:43.761347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.760963    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"
Nov 02 17:55:43.761347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.761000    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" event={"ID":"76d3ff8f-60e8-408d-b497-f70704167445","Type":"ContainerDied","Data":"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"}
Nov 02 17:55:43.761347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.761056    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l" event={"ID":"76d3ff8f-60e8-408d-b497-f70704167445","Type":"ContainerDied","Data":"0de2603215298f7f66475ad295b6e90f410fb8eb2c1f1d9fd8bd990916ddf6ff"}
Nov 02 17:55:43.761347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.761084    5054 scope.go:122] "RemoveContainer" containerID="384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"
Nov 02 17:55:43.773310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.773291    5054 scope.go:122] "RemoveContainer" containerID="384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"
Nov 02 17:55:43.773601 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:43.773583    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7\": container with ID starting with 384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7 not found: ID does not exist" containerID="384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"
Nov 02 17:55:43.773657 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.773611    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7"} err="failed to get container status \"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7\": rpc error: code = NotFound desc = could not find container \"384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7\": container with ID starting with 384c12b75999c5fef46cac2fb4750f718cdf6c7155a09b3e63e67328608ed7f7 not found: ID does not exist"
Nov 02 17:55:43.790070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.790040    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:43.796802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:43.796775    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1b0f58-76587d8cc5-jbz5l"]
Nov 02 17:55:44.052925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.052812    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:55:44.053754 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.053733    5054 cpu_manager.go:414] "containerMap: removing container" podUID="76d3ff8f-60e8-408d-b497-f70704167445" containerName="maas-api"
Nov 02 17:55:44.053754 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.053754    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76d3ff8f-60e8-408d-b497-f70704167445" containerName="maas-api"
Nov 02 17:55:44.053972 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.053917    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="76d3ff8f-60e8-408d-b497-f70704167445" containerName="maas-api"
Nov 02 17:55:44.059208 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.059189    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.075882 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.070273    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f9e86b86-openshift-default-dockercfg-nzt25\""
Nov 02 17:55:44.083304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.081020    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.308483    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.308919    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.308960    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309102    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309360    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309414    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309501    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309612    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.313920 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.309742    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7fhz\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414135    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414192    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414253    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414350    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414397    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414448    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414496    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414569    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7fhz\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.414631    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.415331    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.422861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.419144    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" containerID="cri-o://3303cc3b133cfe359d395974c1075a9688af74010b560f939d4b04f9b5c0e097" gracePeriod=45
Nov 02 17:55:44.441865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.426484    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.441865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.426775    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.441865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.419827    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.441865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.441787    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.452753 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.452674    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7fhz\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.455494 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.455436    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.479718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.478708    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.479718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.478998    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\") pod \"e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") " pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.621930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.621898    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76d3ff8f-60e8-408d-b497-f70704167445" path="/var/lib/kubelet/pods/76d3ff8f-60e8-408d-b497-f70704167445/volumes"
Nov 02 17:55:44.689968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.689887    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:44.794249 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.793974    5054 generic.go:356] "Generic (PLEG): container finished" podID="bdd88d33-f173-432e-a69a-a545867cbde2" containerID="3303cc3b133cfe359d395974c1075a9688af74010b560f939d4b04f9b5c0e097" exitCode=0
Nov 02 17:55:44.794249 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.794159    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" event={"ID":"bdd88d33-f173-432e-a69a-a545867cbde2","Type":"ContainerDied","Data":"3303cc3b133cfe359d395974c1075a9688af74010b560f939d4b04f9b5c0e097"}
Nov 02 17:55:44.846168 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.846141    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:44.847419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.847388    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" podUID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" containerName="maas-api" containerID="cri-o://ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79" gracePeriod=30
Nov 02 17:55:44.870102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.870069    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.925524    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.925874    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.925987    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.926042    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.926087    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.927905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.926138    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\" (UniqueName: \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\") pod \"bdd88d33-f173-432e-a69a-a545867cbde2\" (UID: \"bdd88d33-f173-432e-a69a-a545867cbde2\") "
Nov 02 17:55:44.928979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.928949    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:44.929415 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.929370    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:44.929582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.929567    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:44.929946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.929914    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "kube-api-access-mngxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:44.932983 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.932962    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:44.934156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:44.934129    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs" pod "bdd88d33-f173-432e-a69a-a545867cbde2" (UID: "bdd88d33-f173-432e-a69a-a545867cbde2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032131    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032163    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032173    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd88d33-f173-432e-a69a-a545867cbde2-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032187    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032198    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngxf\" (UniqueName: \"kubernetes.io/projected/bdd88d33-f173-432e-a69a-a545867cbde2-kube-api-access-mngxf\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032207    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd88d33-f173-432e-a69a-a545867cbde2-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.035200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.032932    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:55:45.042502 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.042448    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:45.042790 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.042609    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:45.042790 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.042716    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:45.166557 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.166535    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:45.274860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.253326    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\" (UniqueName: \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\") pod \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") "
Nov 02 17:55:45.290858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.275149    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\") pod \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") "
Nov 02 17:55:45.310156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.291335    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\") pod \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") "
Nov 02 17:55:45.310522 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.310493    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\") pod \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\" (UID: \"8eba29aa-66ae-4fcb-b36c-48e74e0d7898\") "
Nov 02 17:55:45.342874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.295824    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca" pod "8eba29aa-66ae-4fcb-b36c-48e74e0d7898" (UID: "8eba29aa-66ae-4fcb-b36c-48e74e0d7898"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:55:45.342874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.314921    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv" pod "8eba29aa-66ae-4fcb-b36c-48e74e0d7898" (UID: "8eba29aa-66ae-4fcb-b36c-48e74e0d7898"). InnerVolumeSpecName "kube-api-access-x2pwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:45.432415 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.432368    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2pwv\" (UniqueName: \"kubernetes.io/projected/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-kube-api-access-x2pwv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.432686 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.432663    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.525903 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.523515    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs" pod "8eba29aa-66ae-4fcb-b36c-48e74e0d7898" (UID: "8eba29aa-66ae-4fcb-b36c-48e74e0d7898"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:45.535503 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.535450    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.535901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.535874    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls" pod "8eba29aa-66ae-4fcb-b36c-48e74e0d7898" (UID: "8eba29aa-66ae-4fcb-b36c-48e74e0d7898"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:45.638476 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.638443    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eba29aa-66ae-4fcb-b36c-48e74e0d7898-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:45.818256 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.818218    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerStarted","Data":"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"}
Nov 02 17:55:45.818899 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.818874    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerStarted","Data":"bd965b9b472492ccf5e59a23329f6f47e9b2f2462639544952a588495eafd96a"}
Nov 02 17:55:45.821481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.821448    5054 generic.go:356] "Generic (PLEG): container finished" podID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" containerID="ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79" exitCode=0
Nov 02 17:55:45.821627 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.821610    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"
Nov 02 17:55:45.825693 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.825517    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" event={"ID":"8eba29aa-66ae-4fcb-b36c-48e74e0d7898","Type":"ContainerDied","Data":"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"}
Nov 02 17:55:45.825693 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.825570    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf" event={"ID":"8eba29aa-66ae-4fcb-b36c-48e74e0d7898","Type":"ContainerDied","Data":"17970744c839d06533d110bd881dc357a92cec7920644c6a727a210cfb84702f"}
Nov 02 17:55:45.825693 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.825665    5054 scope.go:122] "RemoveContainer" containerID="ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"
Nov 02 17:55:45.826279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.826075    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" event={"ID":"bdd88d33-f173-432e-a69a-a545867cbde2","Type":"ContainerDied","Data":"bc5c06a59fdda790668eed52765208ac5a42ad641fbbb9f35b001478f0db9f0a"}
Nov 02 17:55:45.826279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.826176    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"
Nov 02 17:55:45.826279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.826182    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:45.848420 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.848364    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podStartSLOduration=1.84834342 podStartE2EDuration="1.84834342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:45.843015243 +0000 UTC m=+949.351777310" watchObservedRunningTime="2026-11-02 17:55:45.84834342 +0000 UTC m=+949.357105489"
Nov 02 17:55:45.857064 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.856960    5054 scope.go:122] "RemoveContainer" containerID="ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"
Nov 02 17:55:45.857901 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:45.857691    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79\": container with ID starting with ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79 not found: ID does not exist" containerID="ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"
Nov 02 17:55:45.857901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.857728    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79"} err="failed to get container status \"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79\": rpc error: code = NotFound desc = could not find container \"ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79\": container with ID starting with ee9dc2f429cb464a5fb88e43592a6a28493da669e8874587c9e093d239272c79 not found: ID does not exist"
Nov 02 17:55:45.857901 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.857751    5054 scope.go:122] "RemoveContainer" containerID="3303cc3b133cfe359d395974c1075a9688af74010b560f939d4b04f9b5c0e097"
Nov 02 17:55:45.866650 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:45.866617    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:55:45.883065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.883035    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:55:45.889665 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.889637    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-7b0683/premium-w6-7b0683-kserve-bb8746494-bfxbf"]
Nov 02 17:55:45.897400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.897373    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:45.903823 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:45.903799    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d59fa283-657f7d5f7f-28zmf"]
Nov 02 17:55:46.620767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.620733    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" path="/var/lib/kubelet/pods/8eba29aa-66ae-4fcb-b36c-48e74e0d7898/volumes"
Nov 02 17:55:46.621375 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.621357    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" path="/var/lib/kubelet/pods/bdd88d33-f173-432e-a69a-a545867cbde2/volumes"
Nov 02 17:55:46.690776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.690748    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:46.696567 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.696541    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:46.818390 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.818354    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:55:46.819539 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819511    5054 cpu_manager.go:414] "containerMap: removing container" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main"
Nov 02 17:55:46.819539 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819539    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main"
Nov 02 17:55:46.819715 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819577    5054 cpu_manager.go:414] "containerMap: removing container" podUID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" containerName="maas-api"
Nov 02 17:55:46.819715 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819585    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" containerName="maas-api"
Nov 02 17:55:46.819822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819774    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdd88d33-f173-432e-a69a-a545867cbde2" containerName="main"
Nov 02 17:55:46.819822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.819791    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="8eba29aa-66ae-4fcb-b36c-48e74e0d7898" containerName="maas-api"
Nov 02 17:55:46.826263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.826235    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.845235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.845200    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-33a0a14d-openshift-default-dockercfg-6qsjk\""
Nov 02 17:55:46.851073 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.851045    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:46.852218 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.852193    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:55:46.854038 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.854015    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:55:46.971906 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.971825    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972008    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972064    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972179 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972161    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972207    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972367 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972347    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972424 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972401    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972479 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972438    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpvb7\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:46.972536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:46.972514    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.074560 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074521    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.074776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074587    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.074776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074625    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.074776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074698    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.074776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074739    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074775    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpvb7\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.074806    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075000    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075180 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075098    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075238 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075199    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075585    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075649    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075665    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.075707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.075701    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.077521 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.077495    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.077872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.077818    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.085102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.085077    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpvb7\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.085348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.085329    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\") pod \"e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") " pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.175945 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.175146    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:47.704916 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:55:47.704883    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e692bc1_37ee_426c_89f2_5a44f4bbf7a2.slice/crio-01ad1c7dfeff77b2366cdcf43088c9b278e87f3767118557cc4e3c7519fad011 WatchSource:0}: Error finding container 01ad1c7dfeff77b2366cdcf43088c9b278e87f3767118557cc4e3c7519fad011: Status 404 returned error can't find the container with id 01ad1c7dfeff77b2366cdcf43088c9b278e87f3767118557cc4e3c7519fad011
Nov 02 17:55:47.705893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.705657    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:55:47.708180 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.708098    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:47.708274 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.708231    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:47.708318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.708275    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:55:47.982893 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:47.977495    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerStarted","Data":"01ad1c7dfeff77b2366cdcf43088c9b278e87f3767118557cc4e3c7519fad011"}
Nov 02 17:55:48.489296 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.489229    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:55:48.536318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536282    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536504 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536420    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536504 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536468    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536628 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536513    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536628 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536613    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536666    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.536730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.536710    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.537096 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.537066    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:48.537204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.537120    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.537269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.537227    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\") pod \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\" (UID: \"fb608ed4-e6b7-45b4-8480-d9bcc011bcec\") "
Nov 02 17:55:48.538038 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.537700    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:48.538454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.538186    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:48.538454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.538276    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.538454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.538297    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.538742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.538600    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:48.538997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.538970    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:55:48.540994 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.540769    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:55:48.540994 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.540962    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:48.542630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.542595    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "kube-api-access-zgb4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:48.546389 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.546356    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy" pod "fb608ed4-e6b7-45b4-8480-d9bcc011bcec" (UID: "fb608ed4-e6b7-45b4-8480-d9bcc011bcec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:55:48.639822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639788    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.639822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639819    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.640029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639832    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.640029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639861    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.640029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639873    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.640029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639888    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:48.640029 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:48.639901    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgb4b\" (UniqueName: \"kubernetes.io/projected/fb608ed4-e6b7-45b4-8480-d9bcc011bcec-kube-api-access-zgb4b\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:49.066863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.065883    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerStarted","Data":"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"}
Nov 02 17:55:49.070857 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.068981    5054 generic.go:356] "Generic (PLEG): container finished" podID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" containerID="cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7" exitCode=0
Nov 02 17:55:49.083826 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.083795    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"
Nov 02 17:55:49.087512 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.087343    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" event={"ID":"fb608ed4-e6b7-45b4-8480-d9bcc011bcec","Type":"ContainerDied","Data":"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"}
Nov 02 17:55:49.087512 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.087414    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp" event={"ID":"fb608ed4-e6b7-45b4-8480-d9bcc011bcec","Type":"ContainerDied","Data":"f71e2b3a98cb60d29b194d61bd8e26863741377033f4b377abf19e252e5e7437"}
Nov 02 17:55:49.087512 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.087448    5054 scope.go:122] "RemoveContainer" containerID="cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"
Nov 02 17:55:49.136862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.129456    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podStartSLOduration=3.12943772 podStartE2EDuration="3.12943772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:49.109422536 +0000 UTC m=+952.618184609" watchObservedRunningTime="2026-11-02 17:55:49.12943772 +0000 UTC m=+952.638199787"
Nov 02 17:55:49.184873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.176765    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:49.223860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.213824    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:49.264859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.260539    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:55:49.305071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.305035    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-be1b0f58-gw-openshift-default-5dfddcbb6f-szbsp"]
Nov 02 17:55:49.455427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.412434    5054 scope.go:122] "RemoveContainer" containerID="cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"
Nov 02 17:55:49.455788 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:49.455756    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7\": container with ID starting with cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7 not found: ID does not exist" containerID="cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"
Nov 02 17:55:49.456007 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.455984    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7"} err="failed to get container status \"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7\": rpc error: code = NotFound desc = could not find container \"cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7\": container with ID starting with cb09ecfba9f53a0799c19713b01dc18d5a731562e4a3489654f96326254d0ab7 not found: ID does not exist"
Nov 02 17:55:49.478813 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.478780    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:49.490769 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:49.489609    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" podUID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" containerName="maas-api" containerID="cri-o://6179d8148e981d1c958a896f3a7954ba72f7dce0b8f94104763302bf13e51535" gracePeriod=30
Nov 02 17:55:50.157529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.152469    5054 generic.go:356] "Generic (PLEG): container finished" podID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" containerID="6179d8148e981d1c958a896f3a7954ba72f7dce0b8f94104763302bf13e51535" exitCode=0
Nov 02 17:55:50.157529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.154065    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" event={"ID":"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec","Type":"ContainerDied","Data":"6179d8148e981d1c958a896f3a7954ba72f7dce0b8f94104763302bf13e51535"}
Nov 02 17:55:50.157529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.154125    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:50.167438 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.166228    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:55:50.175889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.174730    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:55:50.255940 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:50.255025    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" containerName="istio-proxy" containerID="cri-o://b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9" gracePeriod=30
Nov 02 17:55:51.128081 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.044560    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:51.488862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.487025    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:51.544889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.539400    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" path="/var/lib/kubelet/pods/fb608ed4-e6b7-45b4-8480-d9bcc011bcec/volumes"
Nov 02 17:55:51.544889 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.539921    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh" event={"ID":"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec","Type":"ContainerDied","Data":"6a0ea6b3fe9feadbdbca140bb8fc5683669264884f5696f3aa3a4f0657517de8"}
Nov 02 17:55:51.553037 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.551930    5054 scope.go:122] "RemoveContainer" containerID="6179d8148e981d1c958a896f3a7954ba72f7dce0b8f94104763302bf13e51535"
Nov 02 17:55:51.561217 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.561191    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\") pod \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") "
Nov 02 17:55:51.561422 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.561402    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\" (UniqueName: \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\") pod \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") "
Nov 02 17:55:51.561656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.561637    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\") pod \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") "
Nov 02 17:55:51.562450 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.562429    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\") pod \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\" (UID: \"bdf28bab-5eed-4ba1-ae9f-96d1235f6bec\") "
Nov 02 17:55:51.565173 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.565149    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca" pod "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" (UID: "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:55:51.582263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.582214    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp" pod "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" (UID: "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec"). InnerVolumeSpecName "kube-api-access-xzcfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:51.584725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.584683    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls" pod "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" (UID: "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:51.649398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.649364    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs" pod "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" (UID: "bdf28bab-5eed-4ba1-ae9f-96d1235f6bec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:51.669150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.665599    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:51.669150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.665631    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzcfp\" (UniqueName: \"kubernetes.io/projected/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-kube-api-access-xzcfp\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:51.669150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.665650    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:51.669150 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:51.665664    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:52.588547 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:52.588512    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"
Nov 02 17:55:52.819010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:52.818977    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:52.860921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:52.852119    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51cd4868-fb945fd7d-vttbh"]
Nov 02 17:55:52.954020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:52.951953    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:55:53.168925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.078555    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:55:53.168925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.078799    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" podUID="e4535363-5bca-4fa9-9918-5668594f871f" containerName="maas-api" containerID="cri-o://a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9" gracePeriod=30
Nov 02 17:55:53.365858 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.363228    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:55:53.651617 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.651576    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:55:53.737190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.690186    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:53.737190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.716854    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:53.953681 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.953633    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:54.008378 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:53.999410    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:55:54.372643 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.363938    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:54.372643 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.364440    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:55:54.692068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.690195    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:54.692068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.691240    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:54.732410 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.732359    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Nov 02 17:55:55.021770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:54.996043    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Nov 02 17:55:55.274077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.273972    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:55.568980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.533607    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 02 17:55:55.692940 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.692895    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" path="/var/lib/kubelet/pods/bdf28bab-5eed-4ba1-ae9f-96d1235f6bec/volumes"
Nov 02 17:55:55.699471 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:55.699441    5054 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.085s"
Nov 02 17:55:55.699748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.699729    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:55:55.712069 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.712039    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:55:55.748032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.747993    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" event={"ID":"e4535363-5bca-4fa9-9918-5668594f871f","Type":"ContainerDied","Data":"a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"}
Nov 02 17:55:55.748351 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.748332    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:55:55.748497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.748485    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:55:55.748622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.748611    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:55:55.748723 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.748713    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:55:55.748894 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.748881    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:55:55.749017 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.702090    5054 generic.go:356] "Generic (PLEG): container finished" podID="e4535363-5bca-4fa9-9918-5668594f871f" containerID="a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9" exitCode=0
Nov 02 17:55:55.749217 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.733032    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:55:55.761859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.756421    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:55:55.903914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.895322    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\") pod \"e4535363-5bca-4fa9-9918-5668594f871f\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") "
Nov 02 17:55:55.903914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.895459    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\" (UniqueName: \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\") pod \"e4535363-5bca-4fa9-9918-5668594f871f\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") "
Nov 02 17:55:55.903914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.895577    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\") pod \"e4535363-5bca-4fa9-9918-5668594f871f\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") "
Nov 02 17:55:55.903914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.895652    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\") pod \"e4535363-5bca-4fa9-9918-5668594f871f\" (UID: \"e4535363-5bca-4fa9-9918-5668594f871f\") "
Nov 02 17:55:55.910581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.909050    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca" pod "e4535363-5bca-4fa9-9918-5668594f871f" (UID: "e4535363-5bca-4fa9-9918-5668594f871f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:55:55.913942 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.913910    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84" pod "e4535363-5bca-4fa9-9918-5668594f871f" (UID: "e4535363-5bca-4fa9-9918-5668594f871f"). InnerVolumeSpecName "kube-api-access-c4j84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:55:55.914543 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.914522    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs" pod "e4535363-5bca-4fa9-9918-5668594f871f" (UID: "e4535363-5bca-4fa9-9918-5668594f871f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:55.915643 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:55.915617    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls" pod "e4535363-5bca-4fa9-9918-5668594f871f" (UID: "e4535363-5bca-4fa9-9918-5668594f871f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:55:56.002178 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.002138    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:56.002178 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.002170    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4535363-5bca-4fa9-9918-5668594f871f-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:56.002178 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.002182    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4j84\" (UniqueName: \"kubernetes.io/projected/e4535363-5bca-4fa9-9918-5668594f871f-kube-api-access-c4j84\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:56.002411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.002196    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4535363-5bca-4fa9-9918-5668594f871f-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:55:56.537370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.537336    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:55:56.538624 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.538598    5054 cpu_manager.go:414] "containerMap: removing container" podUID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" containerName="istio-proxy"
Nov 02 17:55:56.538783 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.538769    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" containerName="istio-proxy"
Nov 02 17:55:56.538933 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.538922    5054 cpu_manager.go:414] "containerMap: removing container" podUID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" containerName="maas-api"
Nov 02 17:55:56.539010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.538999    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" containerName="maas-api"
Nov 02 17:55:56.539108 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.539099    5054 cpu_manager.go:414] "containerMap: removing container" podUID="e4535363-5bca-4fa9-9918-5668594f871f" containerName="maas-api"
Nov 02 17:55:56.539190 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.539180    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4535363-5bca-4fa9-9918-5668594f871f" containerName="maas-api"
Nov 02 17:55:56.539450 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.539438    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4535363-5bca-4fa9-9918-5668594f871f" containerName="maas-api"
Nov 02 17:55:56.539538 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.539529    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb608ed4-e6b7-45b4-8480-d9bcc011bcec" containerName="istio-proxy"
Nov 02 17:55:56.539629 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.539619    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdf28bab-5eed-4ba1-ae9f-96d1235f6bec" containerName="maas-api"
Nov 02 17:55:56.544509 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.544400    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.551680 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.551221    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f9e86b86-serving-cert\""
Nov 02 17:55:56.559588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.559521    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:55:56.612817 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.612773    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.613039 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.612962    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.613112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.613038    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl9hd\" (UniqueName: \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.613112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.613079    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.723874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.723664    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.723874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.723786    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl9hd\" (UniqueName: \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.723874 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.723856    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.735124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.724096    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.735124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.731480    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f9e86b86-serving-cert\""
Nov 02 17:55:56.735124 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.733369    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.765946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.763351    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.786862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.775707    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl9hd\" (UniqueName: \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.889865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.831024    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\") pod \"maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.889865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.838611    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"
Nov 02 17:55:56.889865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.858257    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" event={"ID":"e4535363-5bca-4fa9-9918-5668594f871f","Type":"ContainerDied","Data":"ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4"}
Nov 02 17:55:56.889865 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.858339    5054 scope.go:122] "RemoveContainer" containerID="a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"
Nov 02 17:55:56.907950 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.907905    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:56.922630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.916045    5054 scope.go:122] "RemoveContainer" containerID="a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"
Nov 02 17:55:56.924128 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:56.924081    5054 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_maas-api_maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm_odh-ai-gateway-infra_e4535363-5bca-4fa9-9918-5668594f871f_0 in pod sandbox ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4 from index: no such id: 'a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9'" containerID="a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"
Nov 02 17:55:56.924267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.924133    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9"} err="rpc error: code = Unknown desc = failed to delete container k8s_maas-api_maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm_odh-ai-gateway-infra_e4535363-5bca-4fa9-9918-5668594f871f_0 in pod sandbox ddd81c1bc06d69e217adb285d6ac3bc01f8586b9df83913c8a6e5320f68cd6d4 from index: no such id: 'a469ea1c26181948cf394ca7eda8a217d84dbec54b816ec9f0d07de412a2aaa9'"
Nov 02 17:55:56.934536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.934508    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:55:56.951460 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:56.951435    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm"]
Nov 02 17:55:57.322748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.322656    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:55:57.697209 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.697173    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:55:57.701962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.701937    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:57.722769 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.722726    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f9e86b86\""
Nov 02 17:55:57.739941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.739905    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:55:57.751694 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.751663    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:55:57.759748 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.759720    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:57.764006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.763344    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:55:57.775114 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.775087    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f9e86b86-dockercfg-5t66l\""
Nov 02 17:55:57.819442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.819392    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8ft\" (UniqueName: \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:57.819623 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.819530    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njn85\" (UniqueName: \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:57.819716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.819697    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:57.819960 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.819934    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:57.982860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:57.972378    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-7b0683-846ccbdd57-58gpm" podUID="e4535363-5bca-4fa9-9918-5668594f871f" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.67:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:55:58.029592 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.029555    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:58.047253 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.047215    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:58.069202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.068342    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8ft\" (UniqueName: \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:58.069202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.068489    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njn85\" (UniqueName: \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:58.069202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.050786    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:58.069202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.043087    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:58.069202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.040520    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" event={"ID":"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989","Type":"ContainerStarted","Data":"03f468ab6d6d9ccba1d0ddc61475278de08a95eed8e4df08a1560315f4dc9d56"}
Nov 02 17:55:58.127677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.127601    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8ft\" (UniqueName: \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\") pod \"payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:58.140946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.140917    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njn85\" (UniqueName: \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\") pod \"payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:58.361449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.361361    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:58.379986 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.379958    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:58.625407 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.625319    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4535363-5bca-4fa9-9918-5668594f871f" path="/var/lib/kubelet/pods/e4535363-5bca-4fa9-9918-5668594f871f/volumes"
Nov 02 17:55:58.690204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.690164    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:55:58.765076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:58.765045    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:55:59.061055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.061014    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" event={"ID":"7eb113db-03d1-4133-bff1-a7faedd3496d","Type":"ContainerStarted","Data":"67fc6dee02bb48168e9e112b2c9767f248d48fc55a421d997c906e17bf062c23"}
Nov 02 17:55:59.061255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.061090    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:55:59.061255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.061114    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" event={"ID":"7eb113db-03d1-4133-bff1-a7faedd3496d","Type":"ContainerStarted","Data":"0d6796fe251dcb7b70427f93fc52b683501f7bb8065a4398549056da5a625a39"}
Nov 02 17:55:59.063015 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.062974    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" event={"ID":"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989","Type":"ContainerStarted","Data":"4cdfbf7bfae1dbd4695e4f16067b91960a352af98117e338182661cee31e5857"}
Nov 02 17:55:59.063166 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.063047    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:55:59.064975 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.064939    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" event={"ID":"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c","Type":"ContainerStarted","Data":"99c29280fbcf6c19cf327cd8777a5c2f576be0a13477d04e925d58c720fc47a9"}
Nov 02 17:55:59.065119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.064988    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" event={"ID":"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c","Type":"ContainerStarted","Data":"e4b098532098de7b68bb0f21423cacc7342141122fc223bb1c4dd4f8b0ebebc8"}
Nov 02 17:55:59.065119 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.065106    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:55:59.086024 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.085983    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" podStartSLOduration=2.085970027 podStartE2EDuration="2.085970027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:59.082037317 +0000 UTC m=+962.590799379" watchObservedRunningTime="2026-11-02 17:55:59.085970027 +0000 UTC m=+962.594732093"
Nov 02 17:55:59.109456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.109409    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" podStartSLOduration=2.109396251 podStartE2EDuration="2.109396251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:59.108197795 +0000 UTC m=+962.616959863" watchObservedRunningTime="2026-11-02 17:55:59.109396251 +0000 UTC m=+962.618158318"
Nov 02 17:55:59.131467 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.131419    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" podStartSLOduration=2.4536009 podStartE2EDuration="3.131405716s" totalImagesPullingTime="677.804816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:55:59.12892612 +0000 UTC m=+962.637688189" watchObservedRunningTime="2026-11-02 17:55:59.131405716 +0000 UTC m=+962.640167824"
Nov 02 17:55:59.562725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.562661    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:55:59.582892 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.582800    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:55:59.583077 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.582940    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.589111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.589076    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-33a0a14d-serving-cert\""
Nov 02 17:55:59.764863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.752753    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.764863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.753225    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.764863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.753442    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.764863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.753506    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fg7c\" (UniqueName: \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.854878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.854749    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.854878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.854858    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.855128 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:59.854984    5054 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-serving-cert: secret "maas-api-e2e-derive-33a0a14d-serving-cert" not found
Nov 02 17:55:59.855128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.855033    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.855128 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:55:59.855074    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls podName:050c7db8-3f4c-4e54-9eb6-cf3a687ed846 nodeName:}" failed. No retries permitted until 2026-11-02 17:56:00.355039588 +0000 UTC m=+963.863801653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls") pod "maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" (UID: "050c7db8-3f4c-4e54-9eb6-cf3a687ed846") : secret "maas-api-e2e-derive-33a0a14d-serving-cert" not found
Nov 02 17:55:59.856111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.855139    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fg7c\" (UniqueName: \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.856111 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.855809    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.858661 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.858633    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:55:59.868170 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:55:59.868141    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fg7c\" (UniqueName: \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:00.407971 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.400269    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:00.450860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.447536    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") pod \"maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:00.541722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.541678    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:00.597337 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.597106    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:00.620376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.620238    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:00.627875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.627675    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-33a0a14d\""
Nov 02 17:56:00.627875 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.627781    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-33a0a14d-dockercfg-bhrsd\""
Nov 02 17:56:00.783869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.781631    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:00.783869 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.781775    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqs2q\" (UniqueName: \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:00.890313 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.876402    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:00.900036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.899989    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqs2q\" (UniqueName: \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:00.904700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.900340    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:00.904700 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:00.901325    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:01.063188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:01.061281    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqs2q\" (UniqueName: \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\") pod \"payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") " pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:01.229364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:01.229333    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:56:01.281897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:01.281820    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:01.639241 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:01.639170    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:02.126452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.126409    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" event={"ID":"412d8eb2-8514-4cf5-9b44-66d8fc606746","Type":"ContainerStarted","Data":"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"}
Nov 02 17:56:02.127061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.126484    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" event={"ID":"412d8eb2-8514-4cf5-9b44-66d8fc606746","Type":"ContainerStarted","Data":"3c476512f207d43d00074aabee04644ff9764d2a0bbadd09c175c37642d8bc7e"}
Nov 02 17:56:02.128301 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.128274    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:02.130042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.130012    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" event={"ID":"050c7db8-3f4c-4e54-9eb6-cf3a687ed846","Type":"ContainerStarted","Data":"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"}
Nov 02 17:56:02.130172 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.130065    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" event={"ID":"050c7db8-3f4c-4e54-9eb6-cf3a687ed846","Type":"ContainerStarted","Data":"b95cf3d2c5fb4dd300a49d0bc98621c00ef3f9765584988ddb0caecf1d46e341"}
Nov 02 17:56:02.130925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.130888    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:02.161642 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.159862    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" podStartSLOduration=2.159828921 podStartE2EDuration="2.159828921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:56:02.153183635 +0000 UTC m=+965.661945702" watchObservedRunningTime="2026-11-02 17:56:02.159828921 +0000 UTC m=+965.668590990"
Nov 02 17:56:02.186533 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.186474    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" podStartSLOduration=2.671700494 podStartE2EDuration="3.186458834s" totalImagesPullingTime="514.75834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:56:02.178421469 +0000 UTC m=+965.687183536" watchObservedRunningTime="2026-11-02 17:56:02.186458834 +0000 UTC m=+965.695220900"
Nov 02 17:56:02.193822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.193740    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:56:02.194032 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.193988    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy" containerID="cri-o://5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291" gracePeriod=30
Nov 02 17:56:02.206489 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.206458    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:56:02.206951 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.206921    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" containerID="cri-o://b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b" gracePeriod=30
Nov 02 17:56:02.215330 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.215308    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:56:02.215676 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.215653    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy" containerID="cri-o://e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299" gracePeriod=30
Nov 02 17:56:02.222955 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.222925    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:56:02.223139 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:02.223119    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" containerID="cri-o://7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442" gracePeriod=30
Nov 02 17:56:03.220161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.220115    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 17:56:03.221454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.220181    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:56:03.275087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.275026    5054 patch_prober.go:29] interesting pod/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": read tcp 10.132.0.2:42748->10.132.0.99:15021: read: connection reset by peer" start-of-body=
Nov 02 17:56:03.275241 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.275110    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": read tcp 10.132.0.2:42748->10.132.0.99:15021: read: connection reset by peer"
Nov 02 17:56:03.613226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.613145    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:56:03.741459 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741425    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741479    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741526    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741576    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741608    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741653    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741713    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741744    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.741957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741754    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:03.741957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741790    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\") pod \"47537ac1-a6e7-4348-aa89-679f6549726e\" (UID: \"47537ac1-a6e7-4348-aa89-679f6549726e\") "
Nov 02 17:56:03.742141 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.741995    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:03.742141 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742075    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:03.742279 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742257    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:03.742336 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742307    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:03.742912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742883    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.743020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742914    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47537ac1-a6e7-4348-aa89-679f6549726e-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.743020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742932    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.743020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742949    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.743020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.742966    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.744044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.744019    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:03.744276 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.744249    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:03.744384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.744306    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:03.744384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.744310    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct" pod "47537ac1-a6e7-4348-aa89-679f6549726e" (UID: "47537ac1-a6e7-4348-aa89-679f6549726e"). InnerVolumeSpecName "kube-api-access-hrwct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:03.844505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.844417    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47537ac1-a6e7-4348-aa89-679f6549726e-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.844505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.844448    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47537ac1-a6e7-4348-aa89-679f6549726e-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.844505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.844458    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrwct\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-kube-api-access-hrwct\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:03.844505 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:03.844467    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47537ac1-a6e7-4348-aa89-679f6549726e-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:04.148663 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.148573    5054 generic.go:356] "Generic (PLEG): container finished" podID="47537ac1-a6e7-4348-aa89-679f6549726e" containerID="b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9" exitCode=0
Nov 02 17:56:04.148663 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.148628    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"
Nov 02 17:56:04.148881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.148652    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" event={"ID":"47537ac1-a6e7-4348-aa89-679f6549726e","Type":"ContainerDied","Data":"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"}
Nov 02 17:56:04.148881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.148717    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs" event={"ID":"47537ac1-a6e7-4348-aa89-679f6549726e","Type":"ContainerDied","Data":"01aa3e82d605471507d3242157fe0863c83de29f988dd5427bbe6c3d5e9d1139"}
Nov 02 17:56:04.148881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.148741    5054 scope.go:122] "RemoveContainer" containerID="b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"
Nov 02 17:56:04.160828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.160809    5054 scope.go:122] "RemoveContainer" containerID="b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"
Nov 02 17:56:04.161155 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:04.161133    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9\": container with ID starting with b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9 not found: ID does not exist" containerID="b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"
Nov 02 17:56:04.161207 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.161166    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9"} err="failed to get container status \"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9\": rpc error: code = NotFound desc = could not find container \"b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9\": container with ID starting with b7757f3154d94b4a1302699fd04a55100a076b208f108e1b917ff6a500d811b9 not found: ID does not exist"
Nov 02 17:56:04.182688 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.182492    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:56:04.191589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.191552    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-51cd4868-openshift-default-59844d7c7f-8nrzs"]
Nov 02 17:56:04.622000 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:04.621970    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" path="/var/lib/kubelet/pods/47537ac1-a6e7-4348-aa89-679f6549726e/volumes"
Nov 02 17:56:05.126796 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:05.122310    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:56:06.815577 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:06.815537    5054 patch_prober.go:29] interesting pod/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 17:56:06.816005 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:06.815610    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:56:07.601980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.601949    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:56:07.610052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.604499    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.647803    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648183    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648243    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648295    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648360    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648395    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648444    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648513    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648523    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648549    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648581    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648630    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648675    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648711    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.648965    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649141    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649222    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649233    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:07.649387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649307    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.650235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649488    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.650235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649721    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.650235 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.649961    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.650383 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.650301    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:07.650383 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.650353    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.650479 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.650432    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.650764 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.650722    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.650950 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.650932    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\") pod \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\" (UID: \"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924\") "
Nov 02 17:56:07.651083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.651066    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\") pod \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\" (UID: \"ad4b5792-7d1a-4d14-b033-3451de02b0d7\") "
Nov 02 17:56:07.651604 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.651561    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "kube-api-access-75cm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.653967 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.653947    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655458 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655439    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655577 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655563    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655674 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655662    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655766 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655752    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655876 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655863    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.655988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655975    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.656353 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.656334    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.656471 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.656457    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.656619 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.656603    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75cm9\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-kube-api-access-75cm9\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.657568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.657548    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.657688 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.655895    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.662033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.661998    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.665684 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.665659    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.665788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.665735    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.666369 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.666333    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "kube-api-access-2tdhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.667120 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.667086    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo" pod "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" (UID: "748de55d-c7a4-4f7e-bdf1-99e9f2ae6924"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:07.667636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.667298    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo" pod "ad4b5792-7d1a-4d14-b033-3451de02b0d7" (UID: "ad4b5792-7d1a-4d14-b033-3451de02b0d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:07.719197 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.718136    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:56:07.720298 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.720276    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:56:07.761749 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.761710    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.762052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762028    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.762237 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762220    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.762372 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762355    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.762477 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762450    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:07.762607 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762586    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.762946 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.762921    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.763472 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763447    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.763583 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763543    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.763649 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763619    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.763767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763750    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.763820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763789    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.763933 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763885    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.763993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763951    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.764075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764034    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.764142 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764106    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.764243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.763367    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.764309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764219    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.764309 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764251    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.764423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764307    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\") pod \"64e778a0-454f-4bca-8712-1dc540189897\" (UID: \"64e778a0-454f-4bca-8712-1dc540189897\") "
Nov 02 17:56:07.764423 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764360    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\") pod \"c804d118-2026-4c0f-ae59-0734d8817682\" (UID: \"c804d118-2026-4c0f-ae59-0734d8817682\") "
Nov 02 17:56:07.764531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.764442    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.765623 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.765593    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.765949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.765926    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766072    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766179 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766167    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766260 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766249    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e778a0-454f-4bca-8712-1dc540189897-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766344 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766333    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766416 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766405    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766493 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766483    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4b5792-7d1a-4d14-b033-3451de02b0d7-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766571 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766560    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766655 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766643    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tdhl\" (UniqueName: \"kubernetes.io/projected/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-kube-api-access-2tdhl\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766743 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766732    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.766812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.765941    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.767310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766120    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.767310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766318    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.767434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.766352    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.767434 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.767253    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.767662 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.767640    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:07.768650 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.768616    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "kube-api-access-89hxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.801341 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.801257    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.801624 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.801522    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.801624 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.801590    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "kube-api-access-65pvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.802196 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.801936    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:07.802944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.802879    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:07.803083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.803061    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo" pod "64e778a0-454f-4bca-8712-1dc540189897" (UID: "64e778a0-454f-4bca-8712-1dc540189897"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:07.804887 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.804816    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo" pod "c804d118-2026-4c0f-ae59-0734d8817682" (UID: "c804d118-2026-4c0f-ae59-0734d8817682"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:07.868145 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868113    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89hxs\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-kube-api-access-89hxs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868161    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868172    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65pvx\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-kube-api-access-65pvx\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868192    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868205    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c804d118-2026-4c0f-ae59-0734d8817682-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868218    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c804d118-2026-4c0f-ae59-0734d8817682-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868232    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e778a0-454f-4bca-8712-1dc540189897-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868244    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868253    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e778a0-454f-4bca-8712-1dc540189897-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868263    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868272    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868279    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e778a0-454f-4bca-8712-1dc540189897-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868288    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c804d118-2026-4c0f-ae59-0734d8817682-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:07.868540 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:07.868296    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c804d118-2026-4c0f-ae59-0734d8817682-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:08.227001 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.226964    5054 generic.go:356] "Generic (PLEG): container finished" podID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerID="5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291" exitCode=0
Nov 02 17:56:08.227188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.226996    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" event={"ID":"ad4b5792-7d1a-4d14-b033-3451de02b0d7","Type":"ContainerDied","Data":"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"}
Nov 02 17:56:08.227188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.227039    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"
Nov 02 17:56:08.227188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.227134    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f" event={"ID":"ad4b5792-7d1a-4d14-b033-3451de02b0d7","Type":"ContainerDied","Data":"d2d2fe83ca2294dfb9ed6f36caaa5734b9deafbb0d38dc8d946c3b7ac121a63e"}
Nov 02 17:56:08.227188 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.227169    5054 scope.go:122] "RemoveContainer" containerID="5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"
Nov 02 17:56:08.229349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.229141    5054 generic.go:356] "Generic (PLEG): container finished" podID="c804d118-2026-4c0f-ae59-0734d8817682" containerID="e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299" exitCode=0
Nov 02 17:56:08.229349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.229223    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"
Nov 02 17:56:08.229349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.229247    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" event={"ID":"c804d118-2026-4c0f-ae59-0734d8817682","Type":"ContainerDied","Data":"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"}
Nov 02 17:56:08.229349 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.229287    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn" event={"ID":"c804d118-2026-4c0f-ae59-0734d8817682","Type":"ContainerDied","Data":"9f5e4623e8c0d757147c3e3a04cc84ce70bc3fabe3887770d0df3fefc2096935"}
Nov 02 17:56:08.232344 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.232317    5054 generic.go:356] "Generic (PLEG): container finished" podID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerID="b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b" exitCode=0
Nov 02 17:56:08.232476 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.232460    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" event={"ID":"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924","Type":"ContainerDied","Data":"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"}
Nov 02 17:56:08.232537 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.232499    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd" event={"ID":"748de55d-c7a4-4f7e-bdf1-99e9f2ae6924","Type":"ContainerDied","Data":"343e948a5db0e3147c2d67c0a692355f113a9eef66739479274a520f645054fa"}
Nov 02 17:56:08.232718 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.232669    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"
Nov 02 17:56:08.245206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.236784    5054 generic.go:356] "Generic (PLEG): container finished" podID="64e778a0-454f-4bca-8712-1dc540189897" containerID="7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442" exitCode=0
Nov 02 17:56:08.245206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.236832    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" event={"ID":"64e778a0-454f-4bca-8712-1dc540189897","Type":"ContainerDied","Data":"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"}
Nov 02 17:56:08.245206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.236906    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp" event={"ID":"64e778a0-454f-4bca-8712-1dc540189897","Type":"ContainerDied","Data":"ae1e998fde5bde53934906a8541d388ab9df4b9dc80d1b55ea91fe8509af1989"}
Nov 02 17:56:08.245206 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.236984    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"
Nov 02 17:56:08.271677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.271654    5054 scope.go:122] "RemoveContainer" containerID="5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"
Nov 02 17:56:08.272374 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:08.272352    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291\": container with ID starting with 5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291 not found: ID does not exist" containerID="5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"
Nov 02 17:56:08.272432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.272391    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291"} err="failed to get container status \"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291\": rpc error: code = NotFound desc = could not find container \"5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291\": container with ID starting with 5948584da9a1c37c109ea42eaeff87b4c830543d88211bb5241ba52fbacef291 not found: ID does not exist"
Nov 02 17:56:08.272432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.272417    5054 scope.go:122] "RemoveContainer" containerID="e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"
Nov 02 17:56:08.285933 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.285913    5054 scope.go:122] "RemoveContainer" containerID="e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"
Nov 02 17:56:08.286291 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:08.286265    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299\": container with ID starting with e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299 not found: ID does not exist" containerID="e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"
Nov 02 17:56:08.286380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.286301    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299"} err="failed to get container status \"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299\": rpc error: code = NotFound desc = could not find container \"e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299\": container with ID starting with e33a351b52f61cb99f911e05ca243919e8515d1a10a7a43df64bda5564baa299 not found: ID does not exist"
Nov 02 17:56:08.286380 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.286325    5054 scope.go:122] "RemoveContainer" containerID="b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"
Nov 02 17:56:08.295742 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.295711    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:56:08.299582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.299563    5054 scope.go:122] "RemoveContainer" containerID="b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"
Nov 02 17:56:08.299891 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:08.299865    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b\": container with ID starting with b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b not found: ID does not exist" containerID="b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"
Nov 02 17:56:08.299958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.299902    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b"} err="failed to get container status \"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b\": rpc error: code = NotFound desc = could not find container \"b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b\": container with ID starting with b357a3772b30ac8b1d7e7496235285ea42ce238e715c0c048c8ab45f9f0fb79b not found: ID does not exist"
Nov 02 17:56:08.299958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.299925    5054 scope.go:122] "RemoveContainer" containerID="7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"
Nov 02 17:56:08.302739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.302708    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-9cfqn"]
Nov 02 17:56:08.309518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.309497    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:56:08.314738 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.314716    5054 scope.go:122] "RemoveContainer" containerID="7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"
Nov 02 17:56:08.315121 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:08.315096    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442\": container with ID starting with 7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442 not found: ID does not exist" containerID="7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"
Nov 02 17:56:08.315203 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.315128    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442"} err="failed to get container status \"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442\": rpc error: code = NotFound desc = could not find container \"7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442\": container with ID starting with 7fb6a45ce11e68672dd7beb7c1eee5ef83a67f66f8fcbe95ffbea22ea0e76442 not found: ID does not exist"
Nov 02 17:56:08.316552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.315893    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-2dxwd"]
Nov 02 17:56:08.320964 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.320940    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:56:08.324776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.324753    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wsklp"]
Nov 02 17:56:08.337156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.337133    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:56:08.341506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.341485    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-7b0683-openshift-default-67fb668965-wgt5f"]
Nov 02 17:56:08.619081 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.618999    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64e778a0-454f-4bca-8712-1dc540189897" path="/var/lib/kubelet/pods/64e778a0-454f-4bca-8712-1dc540189897/volumes"
Nov 02 17:56:08.619579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.619560    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" path="/var/lib/kubelet/pods/748de55d-c7a4-4f7e-bdf1-99e9f2ae6924/volumes"
Nov 02 17:56:08.620116 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.620099    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" path="/var/lib/kubelet/pods/ad4b5792-7d1a-4d14-b033-3451de02b0d7/volumes"
Nov 02 17:56:08.621010 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:08.620990    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c804d118-2026-4c0f-ae59-0734d8817682" path="/var/lib/kubelet/pods/c804d118-2026-4c0f-ae59-0734d8817682/volumes"
Nov 02 17:56:09.155436 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:09.155408    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:10.091478 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:10.091448    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:56:10.091678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:10.091522    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:56:11.605079 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:11.605026    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:56:14.152499 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:14.152464    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:15.964649 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:15.964607    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:56:21.196183 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:21.196008    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:56:21.196183 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:21.196085    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:25.816976 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.816936    5054 generic.go:356] "Generic (PLEG): container finished" podID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerID="73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04" exitCode=0
Nov 02 17:56:25.817506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.817015    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerDied","Data":"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"}
Nov 02 17:56:25.817587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.817547    5054 scope.go:122] "RemoveContainer" containerID="73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"
Nov 02 17:56:25.819454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.819419    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:25.819589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.819507    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:25.819589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.819546    5054 generic.go:356] "Generic (PLEG): container finished" podID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerID="1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d" exitCode=0
Nov 02 17:56:25.819589 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.819563    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:25.819805 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.819641    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerDied","Data":"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"}
Nov 02 17:56:25.820160 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.820088    5054 scope.go:122] "RemoveContainer" containerID="1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"
Nov 02 17:56:25.821517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.821484    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:25.821648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.821550    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:25.821648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:25.821586    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:56:26.846765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:26.846732    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerStarted","Data":"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"}
Nov 02 17:56:26.850301 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:26.849584    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerStarted","Data":"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"}
Nov 02 17:56:27.187044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.184435    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:27.187044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.184571    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:27.187044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.184613    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:27.700261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.700225    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:27.716529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.716490    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:27.716810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:27.716780    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:28.190863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.190256    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:28.190863 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.190318    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:28.654207 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.654119    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:56:28.755959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.753635    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:28.755959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.753703    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:28.851921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:28.851576    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:56:29.182648 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:29.182604    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:29.182973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:29.182939    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:29.701864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:29.696074    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:29.701864 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:29.696148    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:30.182236 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:30.182195    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:30.182517 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:30.182490    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:30.703998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:30.703956    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:30.706365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:30.706330    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:31.154214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.154127    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:31.199451 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.199412    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:31.242918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.242871    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:31.692370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.692335    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:31.697872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.692622    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:31.851402 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:31.851373    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:32.179291 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:32.179252    5054 patch_prober.go:29] interesting pod/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 02 17:56:32.179578 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:32.179547    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 02 17:56:32.691720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:32.691677    5054 patch_prober.go:29] interesting pod/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 02 17:56:32.691963 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:32.691754    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 02 17:56:33.182419 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.182388    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:33.182904 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.182871    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:33.183523 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.183502    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:33.655070 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.654949    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" podUID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" containerName="payload-processing" containerID="cri-o://99c29280fbcf6c19cf327cd8777a5c2f576be0a13477d04e925d58c720fc47a9" gracePeriod=25
Nov 02 17:56:33.695595 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.695562    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:33.696777 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.696755    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:33.803529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.803490    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:56:33.804030 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.803992    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" podUID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" containerName="maas-api" containerID="cri-o://4cdfbf7bfae1dbd4695e4f16067b91960a352af98117e338182661cee31e5857" gracePeriod=30
Nov 02 17:56:33.853406 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:33.852698    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" podUID="7eb113db-03d1-4133-bff1-a7faedd3496d" containerName="payload-pre-processing" containerID="cri-o://67fc6dee02bb48168e9e112b2c9767f248d48fc55a421d997c906e17bf062c23" gracePeriod=25
Nov 02 17:56:34.282630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.282382    5054 generic.go:356] "Generic (PLEG): container finished" podID="7eb113db-03d1-4133-bff1-a7faedd3496d" containerID="67fc6dee02bb48168e9e112b2c9767f248d48fc55a421d997c906e17bf062c23" exitCode=0
Nov 02 17:56:34.282630 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.282552    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" event={"ID":"7eb113db-03d1-4133-bff1-a7faedd3496d","Type":"ContainerDied","Data":"67fc6dee02bb48168e9e112b2c9767f248d48fc55a421d997c906e17bf062c23"}
Nov 02 17:56:34.287621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.287410    5054 generic.go:356] "Generic (PLEG): container finished" podID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" containerID="4cdfbf7bfae1dbd4695e4f16067b91960a352af98117e338182661cee31e5857" exitCode=0
Nov 02 17:56:34.287993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.287967    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" event={"ID":"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989","Type":"ContainerDied","Data":"4cdfbf7bfae1dbd4695e4f16067b91960a352af98117e338182661cee31e5857"}
Nov 02 17:56:34.308036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.304814    5054 generic.go:356] "Generic (PLEG): container finished" podID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" containerID="99c29280fbcf6c19cf327cd8777a5c2f576be0a13477d04e925d58c720fc47a9" exitCode=0
Nov 02 17:56:34.308036 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.305750    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" event={"ID":"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c","Type":"ContainerDied","Data":"99c29280fbcf6c19cf327cd8777a5c2f576be0a13477d04e925d58c720fc47a9"}
Nov 02 17:56:34.310945 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.310913    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:56:34.430792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.429267    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\" (UniqueName: \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\") pod \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") "
Nov 02 17:56:34.430792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.429399    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\") pod \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\" (UID: \"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c\") "
Nov 02 17:56:34.435141 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.434929    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85" pod "56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" (UID: "56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c"). InnerVolumeSpecName "kube-api-access-njn85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:34.435885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.435406    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume" pod "56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" (UID: "56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:34.465210 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.465178    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:56:34.534426 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.534389    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\" (UniqueName: \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\") pod \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") "
Nov 02 17:56:34.534636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.534493    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\") pod \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") "
Nov 02 17:56:34.534636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.534560    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\") pod \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") "
Nov 02 17:56:34.534788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.534659    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\") pod \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\" (UID: \"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989\") "
Nov 02 17:56:34.535247 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.535218    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca" pod "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" (UID: "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:34.535558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.535504    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njn85\" (UniqueName: \"kubernetes.io/projected/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-kube-api-access-njn85\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.535558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.535538    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.535558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.535553    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.544883 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.544853    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd" pod "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" (UID: "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989"). InnerVolumeSpecName "kube-api-access-dl9hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:34.545021 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.544828    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls" pod "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" (UID: "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:56:34.546171 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.546128    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs" pod "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" (UID: "fc8a6cd2-0c6e-473a-b1a1-9667b95e4989"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:56:34.551304 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.550983    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:56:34.637342 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.637310    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\" (UniqueName: \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\") pod \"7eb113db-03d1-4133-bff1-a7faedd3496d\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") "
Nov 02 17:56:34.637546 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.637525    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\") pod \"7eb113db-03d1-4133-bff1-a7faedd3496d\" (UID: \"7eb113db-03d1-4133-bff1-a7faedd3496d\") "
Nov 02 17:56:34.637965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.637938    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume" pod "7eb113db-03d1-4133-bff1-a7faedd3496d" (UID: "7eb113db-03d1-4133-bff1-a7faedd3496d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:34.638988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.638964    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl9hd\" (UniqueName: \"kubernetes.io/projected/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-kube-api-access-dl9hd\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.639061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.638994    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.639061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.639009    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.639061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.639025    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb113db-03d1-4133-bff1-a7faedd3496d-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:34.640083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.640034    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft" pod "7eb113db-03d1-4133-bff1-a7faedd3496d" (UID: "7eb113db-03d1-4133-bff1-a7faedd3496d"). InnerVolumeSpecName "kube-api-access-xb8ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:34.740766 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:34.740728    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb8ft\" (UniqueName: \"kubernetes.io/projected/7eb113db-03d1-4133-bff1-a7faedd3496d-kube-api-access-xb8ft\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:35.329530 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.329497    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"
Nov 02 17:56:35.330033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.329492    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh" event={"ID":"56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c","Type":"ContainerDied","Data":"e4b098532098de7b68bb0f21423cacc7342141122fc223bb1c4dd4f8b0ebebc8"}
Nov 02 17:56:35.330033 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.329663    5054 scope.go:122] "RemoveContainer" containerID="99c29280fbcf6c19cf327cd8777a5c2f576be0a13477d04e925d58c720fc47a9"
Nov 02 17:56:35.331272 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.331232    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95" event={"ID":"7eb113db-03d1-4133-bff1-a7faedd3496d","Type":"ContainerDied","Data":"0d6796fe251dcb7b70427f93fc52b683501f7bb8065a4398549056da5a625a39"}
Nov 02 17:56:35.331388 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.331348    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"
Nov 02 17:56:35.338044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.338021    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"
Nov 02 17:56:35.338157 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.338044    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s" event={"ID":"fc8a6cd2-0c6e-473a-b1a1-9667b95e4989","Type":"ContainerDied","Data":"03f468ab6d6d9ccba1d0ddc61475278de08a95eed8e4df08a1560315f4dc9d56"}
Nov 02 17:56:35.344368 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.344276    5054 scope.go:122] "RemoveContainer" containerID="67fc6dee02bb48168e9e112b2c9767f248d48fc55a421d997c906e17bf062c23"
Nov 02 17:56:35.381128 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.381090    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:56:35.388263 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.388230    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e86b86-7d8f64d5bc-qqlmh"]
Nov 02 17:56:35.398396 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.398368    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:56:35.401957 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.401935    5054 scope.go:122] "RemoveContainer" containerID="4cdfbf7bfae1dbd4695e4f16067b91960a352af98117e338182661cee31e5857"
Nov 02 17:56:35.403052 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.403028    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9e86b86-68b98cc8b7-94q8s"]
Nov 02 17:56:35.423581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.423544    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:56:35.430822 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.430785    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e86b86-6ff47d969f-9wn95"]
Nov 02 17:56:35.879475 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.872059    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:56:35.879475 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:35.872330    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy" containerID="cri-o://f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b" gracePeriod=30
Nov 02 17:56:36.102866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.102471    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:56:36.102866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.102752    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" podUID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" containerName="maas-api" containerID="cri-o://b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa" gracePeriod=30
Nov 02 17:56:36.170166 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.170078    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" podUID="412d8eb2-8514-4cf5-9b44-66d8fc606746" containerName="payload-processing" containerID="cri-o://0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f" gracePeriod=25
Nov 02 17:56:36.642518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.642469    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" path="/var/lib/kubelet/pods/56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c/volumes"
Nov 02 17:56:36.643491 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.643462    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eb113db-03d1-4133-bff1-a7faedd3496d" path="/var/lib/kubelet/pods/7eb113db-03d1-4133-bff1-a7faedd3496d/volumes"
Nov 02 17:56:36.644187 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.644152    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" path="/var/lib/kubelet/pods/fc8a6cd2-0c6e-473a-b1a1-9667b95e4989/volumes"
Nov 02 17:56:36.866765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.866732    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:36.879432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.879034    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\" (UniqueName: \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\") pod \"412d8eb2-8514-4cf5-9b44-66d8fc606746\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") "
Nov 02 17:56:36.879432 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.879122    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\") pod \"412d8eb2-8514-4cf5-9b44-66d8fc606746\" (UID: \"412d8eb2-8514-4cf5-9b44-66d8fc606746\") "
Nov 02 17:56:36.880294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.880267    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume" pod "412d8eb2-8514-4cf5-9b44-66d8fc606746" (UID: "412d8eb2-8514-4cf5-9b44-66d8fc606746"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:36.882588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.882513    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/412d8eb2-8514-4cf5-9b44-66d8fc606746-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:36.883440 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.883413    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q" pod "412d8eb2-8514-4cf5-9b44-66d8fc606746" (UID: "412d8eb2-8514-4cf5-9b44-66d8fc606746"). InnerVolumeSpecName "kube-api-access-tqs2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:36.905894 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.905499    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:36.983531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.983490    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\" (UniqueName: \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\") pod \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") "
Nov 02 17:56:36.983531 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.983532    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\") pod \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") "
Nov 02 17:56:36.983917 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.983897    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") pod \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") "
Nov 02 17:56:36.984040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.983950    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\") pod \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\" (UID: \"050c7db8-3f4c-4e54-9eb6-cf3a687ed846\") "
Nov 02 17:56:36.984711 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.984686    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqs2q\" (UniqueName: \"kubernetes.io/projected/412d8eb2-8514-4cf5-9b44-66d8fc606746-kube-api-access-tqs2q\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:36.984829 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.984747    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca" pod "050c7db8-3f4c-4e54-9eb6-cf3a687ed846" (UID: "050c7db8-3f4c-4e54-9eb6-cf3a687ed846"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:36.986555 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.986529    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c" pod "050c7db8-3f4c-4e54-9eb6-cf3a687ed846" (UID: "050c7db8-3f4c-4e54-9eb6-cf3a687ed846"). InnerVolumeSpecName "kube-api-access-9fg7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:36.987118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.987090    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs" pod "050c7db8-3f4c-4e54-9eb6-cf3a687ed846" (UID: "050c7db8-3f4c-4e54-9eb6-cf3a687ed846"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:56:36.987118 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:36.987110    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls" pod "050c7db8-3f4c-4e54-9eb6-cf3a687ed846" (UID: "050c7db8-3f4c-4e54-9eb6-cf3a687ed846"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:56:37.086529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.086389    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fg7c\" (UniqueName: \"kubernetes.io/projected/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-kube-api-access-9fg7c\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:37.086529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.086424    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:37.086529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.086435    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:37.086529 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.086445    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/050c7db8-3f4c-4e54-9eb6-cf3a687ed846-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:37.191085 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.191048    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:56:37.191289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.191262    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy" containerID="cri-o://c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7" gracePeriod=30
Nov 02 17:56:37.450677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.447393    5054 generic.go:356] "Generic (PLEG): container finished" podID="412d8eb2-8514-4cf5-9b44-66d8fc606746" containerID="0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f" exitCode=0
Nov 02 17:56:37.450677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.447482    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" event={"ID":"412d8eb2-8514-4cf5-9b44-66d8fc606746","Type":"ContainerDied","Data":"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"}
Nov 02 17:56:37.450677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.447531    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs" event={"ID":"412d8eb2-8514-4cf5-9b44-66d8fc606746","Type":"ContainerDied","Data":"3c476512f207d43d00074aabee04644ff9764d2a0bbadd09c175c37642d8bc7e"}
Nov 02 17:56:37.450677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.447560    5054 scope.go:122] "RemoveContainer" containerID="0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"
Nov 02 17:56:37.450677 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.447663    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"
Nov 02 17:56:37.454454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.454409    5054 generic.go:356] "Generic (PLEG): container finished" podID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" containerID="b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa" exitCode=0
Nov 02 17:56:37.454569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.454487    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" event={"ID":"050c7db8-3f4c-4e54-9eb6-cf3a687ed846","Type":"ContainerDied","Data":"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"}
Nov 02 17:56:37.454569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.454542    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp" event={"ID":"050c7db8-3f4c-4e54-9eb6-cf3a687ed846","Type":"ContainerDied","Data":"b95cf3d2c5fb4dd300a49d0bc98621c00ef3f9765584988ddb0caecf1d46e341"}
Nov 02 17:56:37.454731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.454713    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"
Nov 02 17:56:37.480042 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.480008    5054 scope.go:122] "RemoveContainer" containerID="0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"
Nov 02 17:56:37.481485 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:37.481323    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f\": container with ID starting with 0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f not found: ID does not exist" containerID="0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"
Nov 02 17:56:37.481485 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.481364    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f"} err="failed to get container status \"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f\": rpc error: code = NotFound desc = could not find container \"0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f\": container with ID starting with 0b5eeff34d5c18c4cc0c4874df1042bdd355af83d695c12cd416ff3bb5f8cb5f not found: ID does not exist"
Nov 02 17:56:37.481485 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.481388    5054 scope.go:122] "RemoveContainer" containerID="b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"
Nov 02 17:56:37.499061 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.499031    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:37.514083 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.514056    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-33a0a14d-6869c7449c-bt6gs"]
Nov 02 17:56:37.528521 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.528492    5054 scope.go:122] "RemoveContainer" containerID="b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"
Nov 02 17:56:37.528928 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:37.528902    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa\": container with ID starting with b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa not found: ID does not exist" containerID="b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"
Nov 02 17:56:37.529056 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.529038    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa"} err="failed to get container status \"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa\": rpc error: code = NotFound desc = could not find container \"b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa\": container with ID starting with b8e540c1b258f338ad7052da0df6e35dd6beae0c969cedad3ffe78f0b3890baa not found: ID does not exist"
Nov 02 17:56:37.529793 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.529781    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:56:37.543271 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:37.543236    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-33a0a14d-5bd964f4d9-k5xpp"]
Nov 02 17:56:38.654627 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:38.654595    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" path="/var/lib/kubelet/pods/050c7db8-3f4c-4e54-9eb6-cf3a687ed846/volumes"
Nov 02 17:56:38.655146 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:38.655128    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="412d8eb2-8514-4cf5-9b44-66d8fc606746" path="/var/lib/kubelet/pods/412d8eb2-8514-4cf5-9b44-66d8fc606746/volumes"
Nov 02 17:56:41.157361 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.157304    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:41.293757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.293721    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.293959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.293821    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294066 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294033    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294066 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294052    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:41.294186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294075    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294146    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294225    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294258    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:41.294294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294283    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294342    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294358    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:41.294442 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294378    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\") pod \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\" (UID: \"80eaa7fa-1abd-4aa2-929a-eee6da1869c1\") "
Nov 02 17:56:41.294735 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294708    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:41.294798 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.294757    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:41.295135 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.295111    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.295299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.295140    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.295299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.295155    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.295299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.295169    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.295299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.295184    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.296768 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.296724    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:41.297398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.297365    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:41.297817 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.297794    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "kube-api-access-x7fhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:41.298097 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.298036    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy" pod "80eaa7fa-1abd-4aa2-929a-eee6da1869c1" (UID: "80eaa7fa-1abd-4aa2-929a-eee6da1869c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:41.396958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.396927    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.396958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.396954    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7fhz\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-kube-api-access-x7fhz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.396958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.396964    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.397265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.396973    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80eaa7fa-1abd-4aa2-929a-eee6da1869c1-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:41.536177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.528502    5054 generic.go:356] "Generic (PLEG): container finished" podID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerID="f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b" exitCode=0
Nov 02 17:56:41.536177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.528698    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerDied","Data":"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"}
Nov 02 17:56:41.536177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.528752    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2" event={"ID":"80eaa7fa-1abd-4aa2-929a-eee6da1869c1","Type":"ContainerDied","Data":"bd965b9b472492ccf5e59a23329f6f47e9b2f2462639544952a588495eafd96a"}
Nov 02 17:56:41.536177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.528781    5054 scope.go:122] "RemoveContainer" containerID="f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"
Nov 02 17:56:41.536177 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.528956    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"
Nov 02 17:56:41.554253 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.554225    5054 scope.go:122] "RemoveContainer" containerID="73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"
Nov 02 17:56:41.570306 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.570275    5054 scope.go:122] "RemoveContainer" containerID="f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"
Nov 02 17:56:41.570727 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:41.570698    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b\": container with ID starting with f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b not found: ID does not exist" containerID="f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"
Nov 02 17:56:41.570897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.570740    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b"} err="failed to get container status \"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b\": rpc error: code = NotFound desc = could not find container \"f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b\": container with ID starting with f51955de21366d9b9245d01ae93e9c74d672393c74e16a9283c4439a5cb4944b not found: ID does not exist"
Nov 02 17:56:41.570897 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.570769    5054 scope.go:122] "RemoveContainer" containerID="73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"
Nov 02 17:56:41.571118 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:41.571092    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04\": container with ID starting with 73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04 not found: ID does not exist" containerID="73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"
Nov 02 17:56:41.571181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.571126    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04"} err="failed to get container status \"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04\": rpc error: code = NotFound desc = could not find container \"73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04\": container with ID starting with 73e7d65fdd2ad1838c63144059121a8175a598e4d690608a1cb9ae926d189c04 not found: ID does not exist"
Nov 02 17:56:41.585196 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.585144    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:56:41.589584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:41.589554    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f9e86b86-openshift-default-6d7ffcfcf7-rxxk2"]
Nov 02 17:56:42.525523 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.525495    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:42.539376 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.539342    5054 generic.go:356] "Generic (PLEG): container finished" podID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerID="c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7" exitCode=0
Nov 02 17:56:42.539518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.539387    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"
Nov 02 17:56:42.539518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.539424    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerDied","Data":"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"}
Nov 02 17:56:42.539518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.539512    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z" event={"ID":"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2","Type":"ContainerDied","Data":"01ad1c7dfeff77b2366cdcf43088c9b278e87f3767118557cc4e3c7519fad011"}
Nov 02 17:56:42.539625 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.539539    5054 scope.go:122] "RemoveContainer" containerID="c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"
Nov 02 17:56:42.552885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.552861    5054 scope.go:122] "RemoveContainer" containerID="1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"
Nov 02 17:56:42.565121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.565099    5054 scope.go:122] "RemoveContainer" containerID="c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"
Nov 02 17:56:42.565467 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:42.565441    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7\": container with ID starting with c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7 not found: ID does not exist" containerID="c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"
Nov 02 17:56:42.565619 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.565591    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7"} err="failed to get container status \"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7\": rpc error: code = NotFound desc = could not find container \"c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7\": container with ID starting with c6696001b94d541952e90fa99f543f163079d5956b10112e5e159e1d4aab57b7 not found: ID does not exist"
Nov 02 17:56:42.565732 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.565720    5054 scope.go:122] "RemoveContainer" containerID="1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"
Nov 02 17:56:42.566160 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:42.566135    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d\": container with ID starting with 1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d not found: ID does not exist" containerID="1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"
Nov 02 17:56:42.566289 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.566249    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d"} err="failed to get container status \"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d\": rpc error: code = NotFound desc = could not find container \"1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d\": container with ID starting with 1802bca1e763906898498d3c9dacf00b8196227ed65c3f7259dbfe30458adb3d not found: ID does not exist"
Nov 02 17:56:42.623767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.623731    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" path="/var/lib/kubelet/pods/80eaa7fa-1abd-4aa2-929a-eee6da1869c1/volumes"
Nov 02 17:56:42.627569 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627541    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.627707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627596    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.627707 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627672    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.627828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627748    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.627828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627777    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.627953 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627823    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:42.627953 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627922    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.628057 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.627941    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:42.628106 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628060    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.628162 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628139    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:42.628216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628147    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.628216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628192    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:56:42.628216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628208    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\") pod \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\" (UID: \"8e692bc1-37ee-426c-89f2-5a44f4bbf7a2\") "
Nov 02 17:56:42.628398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628380    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:42.628824 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628803    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.628949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628827    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.628949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628880    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.628949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628895    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.628949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.628909    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.630781 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.630757    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:56:42.630867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.630812    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:56:42.630867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.630819    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:42.630949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.630877    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7" pod "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" (UID: "8e692bc1-37ee-426c-89f2-5a44f4bbf7a2"). InnerVolumeSpecName "kube-api-access-mpvb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:56:42.730660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.730618    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.730660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.730649    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.730660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.730659    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpvb7\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-kube-api-access-mpvb7\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.730660 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.730675    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:56:42.867802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.867769    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:56:42.877037 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:42.877005    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-33a0a14d-openshift-default-5b88ddc869-h5v6z"]
Nov 02 17:56:44.621195 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:44.621157    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" path="/var/lib/kubelet/pods/8e692bc1-37ee-426c-89f2-5a44f4bbf7a2/volumes"
Nov 02 17:56:44.820541 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:44.820504    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:56:45.918076 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:56:45.918035    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:56:48.705636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:48.705592    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:48.822996 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:48.822946    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:49.412872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.407025    5054 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:49.719918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.718938    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Nov 02 17:56:49.719918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.719359    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4" podUID="0f42dd65-fbba-4ff0-91ee-b306f06d5cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Nov 02 17:56:49.719918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.719596    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:49.720526 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.720179    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:56:49.962872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.929404    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:56:49.962872 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:49.930201    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:56:50.145234 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:50.145136    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 17:56:50.164096 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:56:50.164068    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4"
Nov 02 17:57:09.427552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.426463    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:57:09.427552 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.426788    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" podUID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" containerName="maas-api" containerID="cri-o://1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3" gracePeriod=30
Nov 02 17:57:09.906905 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.906825    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:57:09.958269 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.958229    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\") pod \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") "
Nov 02 17:57:09.958475 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.958389    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\") pod \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") "
Nov 02 17:57:09.958475 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.958441    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\" (UniqueName: \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\") pod \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") "
Nov 02 17:57:09.958599 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.958521    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\") pod \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\" (UID: \"b2221e6c-39a0-4d1a-b521-4c29aa98e73c\") "
Nov 02 17:57:09.959145 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.959109    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca" pod "b2221e6c-39a0-4d1a-b521-4c29aa98e73c" (UID: "b2221e6c-39a0-4d1a-b521-4c29aa98e73c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:09.974220 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.963344    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj" pod "b2221e6c-39a0-4d1a-b521-4c29aa98e73c" (UID: "b2221e6c-39a0-4d1a-b521-4c29aa98e73c"). InnerVolumeSpecName "kube-api-access-xs6sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:09.982356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.980974    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs" pod "b2221e6c-39a0-4d1a-b521-4c29aa98e73c" (UID: "b2221e6c-39a0-4d1a-b521-4c29aa98e73c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:09.982356 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:09.982252    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls" pod "b2221e6c-39a0-4d1a-b521-4c29aa98e73c" (UID: "b2221e6c-39a0-4d1a-b521-4c29aa98e73c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:10.060400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.060363    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:10.060400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.060396    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs6sj\" (UniqueName: \"kubernetes.io/projected/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-kube-api-access-xs6sj\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:10.060400 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.060407    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:10.060627 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.060416    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2221e6c-39a0-4d1a-b521-4c29aa98e73c-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:10.519428 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.519382    5054 generic.go:356] "Generic (PLEG): container finished" podID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" containerID="1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3" exitCode=0
Nov 02 17:57:10.519984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.519440    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"
Nov 02 17:57:10.519984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.519455    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" event={"ID":"b2221e6c-39a0-4d1a-b521-4c29aa98e73c","Type":"ContainerDied","Data":"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"}
Nov 02 17:57:10.519984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.519517    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5" event={"ID":"b2221e6c-39a0-4d1a-b521-4c29aa98e73c","Type":"ContainerDied","Data":"fc5f62ff8f160bdcee4150f03d2fe523ef5a37d473aa0a62c18a056711a4e512"}
Nov 02 17:57:10.519984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.519545    5054 scope.go:122] "RemoveContainer" containerID="1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"
Nov 02 17:57:10.534185 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.534078    5054 scope.go:122] "RemoveContainer" containerID="1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"
Nov 02 17:57:10.535428 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:10.535397    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3\": container with ID starting with 1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3 not found: ID does not exist" containerID="1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"
Nov 02 17:57:10.535585 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.535449    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3"} err="failed to get container status \"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3\": rpc error: code = NotFound desc = could not find container \"1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3\": container with ID starting with 1c7f123b9952c2b1b2d4884e8ca7583f499863a5c9de0cf322300b36712504e3 not found: ID does not exist"
Nov 02 17:57:10.559848 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.559803    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:57:10.565883 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.565855    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f37d16-5bd68cd754-4h2f5"]
Nov 02 17:57:10.619446 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:10.619416    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" path="/var/lib/kubelet/pods/b2221e6c-39a0-4d1a-b521-4c29aa98e73c/volumes"
Nov 02 17:57:12.794911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:12.789074    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:57:12.794911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:12.789310    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" podUID="e7d64d16-7368-4c53-abdc-0e7412f98392" containerName="maas-api" containerID="cri-o://2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973" gracePeriod=30
Nov 02 17:57:13.330164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.329864    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:57:13.457698 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.457660    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\") pod \"e7d64d16-7368-4c53-abdc-0e7412f98392\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") "
Nov 02 17:57:13.457968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.457820    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\") pod \"e7d64d16-7368-4c53-abdc-0e7412f98392\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") "
Nov 02 17:57:13.457968 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.457924    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\") pod \"e7d64d16-7368-4c53-abdc-0e7412f98392\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") "
Nov 02 17:57:13.458236 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.458023    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\" (UniqueName: \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\") pod \"e7d64d16-7368-4c53-abdc-0e7412f98392\" (UID: \"e7d64d16-7368-4c53-abdc-0e7412f98392\") "
Nov 02 17:57:13.458415 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.458381    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca" pod "e7d64d16-7368-4c53-abdc-0e7412f98392" (UID: "e7d64d16-7368-4c53-abdc-0e7412f98392"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:13.458716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.458697    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d64d16-7368-4c53-abdc-0e7412f98392-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:13.460814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.460774    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz" pod "e7d64d16-7368-4c53-abdc-0e7412f98392" (UID: "e7d64d16-7368-4c53-abdc-0e7412f98392"). InnerVolumeSpecName "kube-api-access-jjxlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:13.460814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.460793    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls" pod "e7d64d16-7368-4c53-abdc-0e7412f98392" (UID: "e7d64d16-7368-4c53-abdc-0e7412f98392"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:13.462216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.462194    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs" pod "e7d64d16-7368-4c53-abdc-0e7412f98392" (UID: "e7d64d16-7368-4c53-abdc-0e7412f98392"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:13.547202 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.547168    5054 generic.go:356] "Generic (PLEG): container finished" podID="e7d64d16-7368-4c53-abdc-0e7412f98392" containerID="2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973" exitCode=0
Nov 02 17:57:13.547398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.547225    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"
Nov 02 17:57:13.547398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.547240    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" event={"ID":"e7d64d16-7368-4c53-abdc-0e7412f98392","Type":"ContainerDied","Data":"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"}
Nov 02 17:57:13.547398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.547307    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r" event={"ID":"e7d64d16-7368-4c53-abdc-0e7412f98392","Type":"ContainerDied","Data":"ade4ba539a590625b9aa1593eff7b3947f86fa31f19d107ee38982e1cf466737"}
Nov 02 17:57:13.547398 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.547337    5054 scope.go:122] "RemoveContainer" containerID="2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"
Nov 02 17:57:13.560342 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.560310    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjxlz\" (UniqueName: \"kubernetes.io/projected/e7d64d16-7368-4c53-abdc-0e7412f98392-kube-api-access-jjxlz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:13.560342 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.560342    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:13.560595 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.560359    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7d64d16-7368-4c53-abdc-0e7412f98392-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:13.564026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.562880    5054 scope.go:122] "RemoveContainer" containerID="2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"
Nov 02 17:57:13.564026 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:13.563243    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973\": container with ID starting with 2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973 not found: ID does not exist" containerID="2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"
Nov 02 17:57:13.564026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.563279    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973"} err="failed to get container status \"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973\": rpc error: code = NotFound desc = could not find container \"2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973\": container with ID starting with 2455a90d5d8b4db71011ae4fb1b253a0d2f2ede7131878f8550b3e8f74520973 not found: ID does not exist"
Nov 02 17:57:13.576352 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.576324    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:57:13.582366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:13.582339    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-ea3867-7467d984db-dd22r"]
Nov 02 17:57:14.630878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:14.630832    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7d64d16-7368-4c53-abdc-0e7412f98392" path="/var/lib/kubelet/pods/e7d64d16-7368-4c53-abdc-0e7412f98392/volumes"
Nov 02 17:57:15.841757 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:15.841696    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:57:18.060744 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.060709    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:57:18.061262 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.061023    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy" containerID="cri-o://89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c" gracePeriod=30
Nov 02 17:57:18.067080 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.067054    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:57:18.067962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.067931    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy" containerID="cri-o://c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af" gracePeriod=30
Nov 02 17:57:18.084267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.084239    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:57:18.084751 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:18.084719    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy" containerID="cri-o://bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01" gracePeriod=30
Nov 02 17:57:23.427632 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.427602    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:57:23.453729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.453687    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:57:23.459300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.459278    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:57:23.507993 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.486408    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.508296 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.507177    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.508544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.508523    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.509088 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.508973    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.510255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.510232    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.510277    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.510309    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.510385    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511048    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511109    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511194    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511237    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511305    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511347    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511449    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511521    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511587    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511642    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511679    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\") pod \"6f6d507b-c995-4b15-8599-918ad9499f8b\" (UID: \"6f6d507b-c995-4b15-8599-918ad9499f8b\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.511748    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\") pod \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\" (UID: \"71a3ed4e-2dcf-4683-ab05-8c140a5658db\") "
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.512552    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.512575    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.512858    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.513050    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.513246    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.513445    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.517052    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.517424    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.517655    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.529290 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.523379    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.530495 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.529581    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.532646 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.532514    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "kube-api-access-zpd78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.532810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.532736    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.533123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.533100    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:23.541397 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.541343    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:23.541397 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.541363    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s" pod "71a3ed4e-2dcf-4683-ab05-8c140a5658db" (UID: "71a3ed4e-2dcf-4683-ab05-8c140a5658db"). InnerVolumeSpecName "kube-api-access-pwq6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.543346 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.543311    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.544786 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.544751    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo" pod "6f6d507b-c995-4b15-8599-918ad9499f8b" (UID: "6f6d507b-c995-4b15-8599-918ad9499f8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:23.613770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.613670    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.613770 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.613766    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.613821    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.613923    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614053 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.613989    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.614056    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.614113    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.614139    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.614223 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.614180    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\") pod \"28ac0470-6653-4011-ade7-6539315c395b\" (UID: \"28ac0470-6653-4011-ade7-6539315c395b\") "
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.614973    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615003    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615019    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615032    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615046    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwq6s\" (UniqueName: \"kubernetes.io/projected/71a3ed4e-2dcf-4683-ab05-8c140a5658db-kube-api-access-pwq6s\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615061    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615074    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615088    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615102    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615116    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615132    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f6d507b-c995-4b15-8599-918ad9499f8b-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615145    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615160    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a3ed4e-2dcf-4683-ab05-8c140a5658db-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615175    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f6d507b-c995-4b15-8599-918ad9499f8b-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615188    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f6d507b-c995-4b15-8599-918ad9499f8b-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615202    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpd78\" (UniqueName: \"kubernetes.io/projected/6f6d507b-c995-4b15-8599-918ad9499f8b-kube-api-access-zpd78\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615447    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615632    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615675    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.615962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.615917    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:23.617310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.617276    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.619980 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.619941    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.620191 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.620151    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:23.620528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.620492    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:23.622456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.622421    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g" pod "28ac0470-6653-4011-ade7-6539315c395b" (UID: "28ac0470-6653-4011-ade7-6539315c395b"). InnerVolumeSpecName "kube-api-access-tlv7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:23.646982 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.646944    5054 generic.go:356] "Generic (PLEG): container finished" podID="28ac0470-6653-4011-ade7-6539315c395b" containerID="89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c" exitCode=0
Nov 02 17:57:23.647697 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.647398    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"
Nov 02 17:57:23.653076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.652887    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerDied","Data":"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"}
Nov 02 17:57:23.653076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.652954    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg" event={"ID":"28ac0470-6653-4011-ade7-6539315c395b","Type":"ContainerDied","Data":"f52e35d6f76aa3611df60c9e80069921b181cde924638585654bcbaa43a2ca1e"}
Nov 02 17:57:23.653076 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.652984    5054 scope.go:122] "RemoveContainer" containerID="89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"
Nov 02 17:57:23.659103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.658947    5054 generic.go:356] "Generic (PLEG): container finished" podID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerID="c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af" exitCode=0
Nov 02 17:57:23.659103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.659020    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"
Nov 02 17:57:23.659103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.659041    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" event={"ID":"71a3ed4e-2dcf-4683-ab05-8c140a5658db","Type":"ContainerDied","Data":"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"}
Nov 02 17:57:23.659103 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.659091    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv" event={"ID":"71a3ed4e-2dcf-4683-ab05-8c140a5658db","Type":"ContainerDied","Data":"8cc4d6e00cbe925543ca4a578c4a08a00b37298796ae96b99251d14870e6b2ae"}
Nov 02 17:57:23.663227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.663101    5054 generic.go:356] "Generic (PLEG): container finished" podID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerID="bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01" exitCode=0
Nov 02 17:57:23.663227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.663148    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" event={"ID":"6f6d507b-c995-4b15-8599-918ad9499f8b","Type":"ContainerDied","Data":"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"}
Nov 02 17:57:23.663227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.663158    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"
Nov 02 17:57:23.663227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.663188    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m" event={"ID":"6f6d507b-c995-4b15-8599-918ad9499f8b","Type":"ContainerDied","Data":"d0976e022297e8344c70144be00332489080af56e6e733d55f708349e62a71cf"}
Nov 02 17:57:23.686807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.686784    5054 scope.go:122] "RemoveContainer" containerID="47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"
Nov 02 17:57:23.712078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.712012    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:57:23.722979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.722509    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-ls4qg"]
Nov 02 17:57:23.723958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.723808    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.723958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.723903    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlv7g\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-kube-api-access-tlv7g\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.723958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.723921    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.725786 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.723937    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.725938 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.724743    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.726172 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.726044    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ac0470-6653-4011-ade7-6539315c395b-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.726172 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.726114    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ac0470-6653-4011-ade7-6539315c395b-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.726172 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.726128    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ac0470-6653-4011-ade7-6539315c395b-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.726172 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.726142    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ac0470-6653-4011-ade7-6539315c395b-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:23.730232 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.730209    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:57:23.734401 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.734378    5054 scope.go:122] "RemoveContainer" containerID="89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"
Nov 02 17:57:23.735217 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:23.735189    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c\": container with ID starting with 89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c not found: ID does not exist" containerID="89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"
Nov 02 17:57:23.735317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.735242    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c"} err="failed to get container status \"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c\": rpc error: code = NotFound desc = could not find container \"89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c\": container with ID starting with 89988ce1a7aac257744a0fffb72b555733f0e5de095ea47c22e0f52d917add8c not found: ID does not exist"
Nov 02 17:57:23.735317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.735268    5054 scope.go:122] "RemoveContainer" containerID="47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"
Nov 02 17:57:23.735925 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:23.735735    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94\": container with ID starting with 47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94 not found: ID does not exist" containerID="47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"
Nov 02 17:57:23.735925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.735770    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94"} err="failed to get container status \"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94\": rpc error: code = NotFound desc = could not find container \"47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94\": container with ID starting with 47fc59f825ea37a81d36a85c5de000c06474ab006cceccfc1786347a53186b94 not found: ID does not exist"
Nov 02 17:57:23.735925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.735789    5054 scope.go:122] "RemoveContainer" containerID="c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"
Nov 02 17:57:23.747040 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.747008    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-n6wnv"]
Nov 02 17:57:23.767668 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.767580    5054 scope.go:122] "RemoveContainer" containerID="c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"
Nov 02 17:57:23.767993 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:23.767968    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af\": container with ID starting with c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af not found: ID does not exist" containerID="c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"
Nov 02 17:57:23.768100 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.768003    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af"} err="failed to get container status \"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af\": rpc error: code = NotFound desc = could not find container \"c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af\": container with ID starting with c136fcadb8583ae86f50d06b6d2f13b72a0789a84ca1727731f62639392168af not found: ID does not exist"
Nov 02 17:57:23.768100 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.768043    5054 scope.go:122] "RemoveContainer" containerID="bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"
Nov 02 17:57:23.768551 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.768535    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:57:23.768731 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.768707    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy" containerID="cri-o://578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2" gracePeriod=30
Nov 02 17:57:23.774788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.774738    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:57:23.778785 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.778762    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f37d16-openshift-default-75474b5775-sg65m"]
Nov 02 17:57:23.782246 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.782221    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:57:23.782437 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.782413    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy" containerID="cri-o://36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355" gracePeriod=30
Nov 02 17:57:23.786350 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.786327    5054 scope.go:122] "RemoveContainer" containerID="bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"
Nov 02 17:57:23.786657 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:23.786639    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01\": container with ID starting with bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01 not found: ID does not exist" containerID="bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"
Nov 02 17:57:23.786737 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.786673    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01"} err="failed to get container status \"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01\": rpc error: code = NotFound desc = could not find container \"bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01\": container with ID starting with bc2d857a6b7773b4c88dba1041f2fbf0621e65d214120249910a0436c809cf01 not found: ID does not exist"
Nov 02 17:57:23.789176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.789156    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:57:23.789347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:23.789328    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy" containerID="cri-o://a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472" gracePeriod=30
Nov 02 17:57:24.620176 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:24.620144    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28ac0470-6653-4011-ade7-6539315c395b" path="/var/lib/kubelet/pods/28ac0470-6653-4011-ade7-6539315c395b/volumes"
Nov 02 17:57:24.620710 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:24.620684    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" path="/var/lib/kubelet/pods/6f6d507b-c995-4b15-8599-918ad9499f8b/volumes"
Nov 02 17:57:24.621164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:24.621150    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" path="/var/lib/kubelet/pods/71a3ed4e-2dcf-4683-ab05-8c140a5658db/volumes"
Nov 02 17:57:25.868802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:25.868771    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:57:29.291492 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.291462    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:57:29.298403 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.298374    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.298919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.298896    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.299168 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299150    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.299310 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299294    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.299470 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299452    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.299628 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299614    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.299815 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299797    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.300017 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.299999    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.300231 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.300213    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\") pod \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\" (UID: \"9f6b1fb8-4e62-46f4-982f-fe179c62bea1\") "
Nov 02 17:57:29.322799 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.298826    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.323722 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.323450    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:29.324601 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.324283    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.325977 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.325934    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.340747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.340688    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:29.343931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.343884    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.343931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.343916    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.346737 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.346699    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.347507 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.347473    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt" pod "9f6b1fb8-4e62-46f4-982f-fe179c62bea1" (UID: "9f6b1fb8-4e62-46f4-982f-fe179c62bea1"). InnerVolumeSpecName "kube-api-access-bfmkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.367518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.367492    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:57:29.421871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.421806    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.422522 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.422499    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.423169 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.423146    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.423658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.423637    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.424086 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.424068    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.424584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.422422    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:29.424584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.423569    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.424584 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.423981    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.425155 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.424830    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.425669 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.425635    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.425794 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.425775    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.425970 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.425952    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.426453 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.426435    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\") pod \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\" (UID: \"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3\") "
Nov 02 17:57:29.426878 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.426805    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.427687 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.427667    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.427820 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.427806    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428020 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428004    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428121 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428108    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428219 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428206    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428304    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428408 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428395    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428497 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428485    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428576    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428671 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428658    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428752 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428740    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428855 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428826    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.428965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.428952    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.429071 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.429058    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfmkt\" (UniqueName: \"kubernetes.io/projected/9f6b1fb8-4e62-46f4-982f-fe179c62bea1-kube-api-access-bfmkt\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.429228 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.429211    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.432294 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.432257    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "kube-api-access-6gkk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.432544 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.432507    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.433239 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.433204    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo" pod "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" (UID: "db7f8da7-3f02-43f3-8315-2c0c4a04c7a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:29.531384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.531295    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.531384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.531337    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gkk5\" (UniqueName: \"kubernetes.io/projected/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-kube-api-access-6gkk5\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.531384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.531354    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.531384 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.531369    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.597914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.584436    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.626970    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.627031    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633526    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633581    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633633    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633663    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633786    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633875    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633914    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.633973    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.634016    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\") pod \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\" (UID: \"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc\") "
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.634889    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.635361    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.635542    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.636115    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.636667    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.638137    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.638950    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:57:29.639881 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.639615    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "kube-api-access-tc7mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:29.641761 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.640955    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy" pod "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" (UID: "0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736657    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7mv\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-kube-api-access-tc7mv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736692    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736705    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736719    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736732    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736743    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736755    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736768    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.736788 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.736782    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:29.861229 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.857239    5054 generic.go:356] "Generic (PLEG): container finished" podID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerID="578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2" exitCode=0
Nov 02 17:57:29.861229 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.857521    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" event={"ID":"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc","Type":"ContainerDied","Data":"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"}
Nov 02 17:57:29.861229 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.857574    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc" event={"ID":"0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc","Type":"ContainerDied","Data":"1d7b03172a7d5444c672b24aea8dbf9bd46a570a2fb51dc41bcdc3db647c1fd1"}
Nov 02 17:57:29.861229 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.857601    5054 scope.go:122] "RemoveContainer" containerID="578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"
Nov 02 17:57:29.861229 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.857745    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"
Nov 02 17:57:29.862453 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.862423    5054 generic.go:356] "Generic (PLEG): container finished" podID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerID="a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472" exitCode=0
Nov 02 17:57:29.862582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.862562    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" event={"ID":"9f6b1fb8-4e62-46f4-982f-fe179c62bea1","Type":"ContainerDied","Data":"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"}
Nov 02 17:57:29.862659 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.862618    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg" event={"ID":"9f6b1fb8-4e62-46f4-982f-fe179c62bea1","Type":"ContainerDied","Data":"02b7890a96d9704eb2a95c9b07eab04de533bd8ec26c26baf606c6ecc2fdfb83"}
Nov 02 17:57:29.862729 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.862704    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"
Nov 02 17:57:29.876990 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.876961    5054 generic.go:356] "Generic (PLEG): container finished" podID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerID="36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355" exitCode=0
Nov 02 17:57:29.877212 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.877193    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" event={"ID":"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3","Type":"ContainerDied","Data":"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"}
Nov 02 17:57:29.877347 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.877333    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv" event={"ID":"db7f8da7-3f02-43f3-8315-2c0c4a04c7a3","Type":"ContainerDied","Data":"fb0a944556fe070b667fc880a7eac1dde38aca7c2acab6ea52379c1db2088402"}
Nov 02 17:57:29.877506 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.877491    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"
Nov 02 17:57:29.900494 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.900369    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:57:29.913892 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.913863    5054 scope.go:122] "RemoveContainer" containerID="578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"
Nov 02 17:57:29.914315 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:29.914287    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2\": container with ID starting with 578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2 not found: ID does not exist" containerID="578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"
Nov 02 17:57:29.914427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.914328    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2"} err="failed to get container status \"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2\": rpc error: code = NotFound desc = could not find container \"578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2\": container with ID starting with 578989a8aa9ed6149aefdfdf8734f5612fb86de4f5cb5353cbdbafa3d61a6ca2 not found: ID does not exist"
Nov 02 17:57:29.914427 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.914352    5054 scope.go:122] "RemoveContainer" containerID="a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"
Nov 02 17:57:29.915035 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.915008    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hqbwc"]
Nov 02 17:57:29.931451 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.931386    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:57:29.933621 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.933525    5054 scope.go:122] "RemoveContainer" containerID="a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"
Nov 02 17:57:29.934066 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:29.934043    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472\": container with ID starting with a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472 not found: ID does not exist" containerID="a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"
Nov 02 17:57:29.934186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.934089    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472"} err="failed to get container status \"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472\": rpc error: code = NotFound desc = could not find container \"a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472\": container with ID starting with a4b35d68ee58711f1e4a57e507250bca0ff56798e9d8621e04d8c6db8784d472 not found: ID does not exist"
Nov 02 17:57:29.934186 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.934114    5054 scope.go:122] "RemoveContainer" containerID="36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"
Nov 02 17:57:29.937937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.937915    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-szbtg"]
Nov 02 17:57:29.946983 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.946959    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:57:29.947074 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.946984    5054 scope.go:122] "RemoveContainer" containerID="36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"
Nov 02 17:57:29.953723 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.953684    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ea3867-openshift-default-7cfbcc5795-hmzzv"]
Nov 02 17:57:29.956283 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:29.956257    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355\": container with ID starting with 36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355 not found: ID does not exist" containerID="36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"
Nov 02 17:57:29.956387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:29.956295    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355"} err="failed to get container status \"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355\": rpc error: code = NotFound desc = could not find container \"36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355\": container with ID starting with 36f9ee4802089e7a17214aac8246e416b2eb89c40816576557b883abf06d9355 not found: ID does not exist"
Nov 02 17:57:30.139985 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:30.139899    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:57:30.159451 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:30.159420    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:57:30.619568 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:30.619528    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" path="/var/lib/kubelet/pods/0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc/volumes"
Nov 02 17:57:30.620271 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:30.620248    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" path="/var/lib/kubelet/pods/9f6b1fb8-4e62-46f4-982f-fe179c62bea1/volumes"
Nov 02 17:57:30.620800 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:30.620779    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" path="/var/lib/kubelet/pods/db7f8da7-3f02-43f3-8315-2c0c4a04c7a3/volumes"
Nov 02 17:57:35.487814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:35.487773    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:57:39.217366 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.217324    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"]
Nov 02 17:57:39.218287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218261    5054 cpu_manager.go:414] "containerMap: removing container" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:57:39.218287 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218287    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218303    5054 cpu_manager.go:414] "containerMap: removing container" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218311    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218329    5054 cpu_manager.go:414] "containerMap: removing container" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218339    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218350    5054 cpu_manager.go:414] "containerMap: removing container" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218358    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218371    5054 cpu_manager.go:414] "containerMap: removing container" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218378    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218388    5054 cpu_manager.go:414] "containerMap: removing container" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218396    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218408    5054 cpu_manager.go:414] "containerMap: removing container" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218417    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218433    5054 cpu_manager.go:414] "containerMap: removing container" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218441    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy"
Nov 02 17:57:39.218452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218460    5054 cpu_manager.go:414] "containerMap: removing container" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218467    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218478    5054 cpu_manager.go:414] "containerMap: removing container" podUID="7eb113db-03d1-4133-bff1-a7faedd3496d" containerName="payload-pre-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218486    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eb113db-03d1-4133-bff1-a7faedd3496d" containerName="payload-pre-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218499    5054 cpu_manager.go:414] "containerMap: removing container" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218507    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218518    5054 cpu_manager.go:414] "containerMap: removing container" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218524    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218533    5054 cpu_manager.go:414] "containerMap: removing container" podUID="412d8eb2-8514-4cf5-9b44-66d8fc606746" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218542    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="412d8eb2-8514-4cf5-9b44-66d8fc606746" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218565    5054 cpu_manager.go:414] "containerMap: removing container" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218572    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218582    5054 cpu_manager.go:414] "containerMap: removing container" podUID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218588    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218613    5054 cpu_manager.go:414] "containerMap: removing container" podUID="e7d64d16-7368-4c53-abdc-0e7412f98392" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218620    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7d64d16-7368-4c53-abdc-0e7412f98392" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218632    5054 cpu_manager.go:414] "containerMap: removing container" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218639    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218657    5054 cpu_manager.go:414] "containerMap: removing container" podUID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218670    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218687    5054 cpu_manager.go:414] "containerMap: removing container" podUID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218696    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218710    5054 cpu_manager.go:414] "containerMap: removing container" podUID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218717    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218726    5054 cpu_manager.go:414] "containerMap: removing container" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218733    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218880    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cbb4cc1-cafa-414a-bdf4-1ff051b50fcc" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218895    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="db7f8da7-3f02-43f3-8315-2c0c4a04c7a3" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218907    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eb113db-03d1-4133-bff1-a7faedd3496d" containerName="payload-pre-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218915    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218923    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="64e778a0-454f-4bca-8712-1dc540189897" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218933    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f6b1fb8-4e62-46f4-982f-fe179c62bea1" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218942    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="412d8eb2-8514-4cf5-9b44-66d8fc606746" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218952    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="71a3ed4e-2dcf-4683-ab05-8c140a5658db" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218960    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc8a6cd2-0c6e-473a-b1a1-9667b95e4989" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218970    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7d64d16-7368-4c53-abdc-0e7412f98392" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218978    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="c804d118-2026-4c0f-ae59-0734d8817682" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218989    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="050c7db8-3f4c-4e54-9eb6-cf3a687ed846" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.218998    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="56087c4a-3ef8-4f3a-b1c8-5aa2f6bf9d5c" containerName="payload-processing"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219004    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219012    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2221e6c-39a0-4d1a-b521-4c29aa98e73c" containerName="maas-api"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219019    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f6d507b-c995-4b15-8599-918ad9499f8b" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219027    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="748de55d-c7a4-4f7e-bdf1-99e9f2ae6924" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219035    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219042    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="47537ac1-a6e7-4348-aa89-679f6549726e" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219049    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e692bc1-37ee-426c-89f2-5a44f4bbf7a2" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219057    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad4b5792-7d1a-4d14-b033-3451de02b0d7" containerName="istio-proxy"
Nov 02 17:57:39.219200 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.219066    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:57:39.223941 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.223918    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.229605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.229580    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 17:57:39.230430 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.230407    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 17:57:39.233142 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.233116    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"]
Nov 02 17:57:39.291022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.290991    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.291227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.291041    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlw2k\" (UniqueName: \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.291227 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.291129    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.393043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.393000    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.393212 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.393157    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlw2k\" (UniqueName: \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.393212 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.393205    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.393942 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.393913    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.395866 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.395820    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.401404 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.401380    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlw2k\" (UniqueName: \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\") pod \"maas-api-revoke-sub-a3fa5109-754b4\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.547965 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.547519    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:39.848797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.848766    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"]
Nov 02 17:57:39.850122 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:57:39.850095    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2431bef3_ad2c_4304_83ed_41cf2b404fa7.slice/crio-0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392 WatchSource:0}: Error finding container 0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392: Status 404 returned error can't find the container with id 0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392
Nov 02 17:57:39.852112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.852094    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 17:57:39.959231 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:39.959198    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4" event={"ID":"2431bef3-ad2c-4304-83ed-41cf2b404fa7","Type":"ContainerStarted","Data":"0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392"}
Nov 02 17:57:40.488830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:40.488769    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing" containerID="cri-o://a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996" gracePeriod=25
Nov 02 17:57:43.013608 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:43.013550    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4" podStartSLOduration=1.375869898 podStartE2EDuration="4.01353268s" totalImagesPullingTime="2.637662782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:57:43.011224315 +0000 UTC m=+1066.519986381" watchObservedRunningTime="2026-11-02 17:57:43.01353268 +0000 UTC m=+1066.522294747"
Nov 02 17:57:43.997914 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:43.997873    5054 generic.go:356] "Generic (PLEG): container finished" podID="2431bef3-ad2c-4304-83ed-41cf2b404fa7" containerID="78cde3174c3076a0c89e3674287653b9c730e86de341f4e958963dc6f70c0519" exitCode=0
Nov 02 17:57:43.998084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:43.997924    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4" event={"ID":"2431bef3-ad2c-4304-83ed-41cf2b404fa7","Type":"ContainerDied","Data":"78cde3174c3076a0c89e3674287653b9c730e86de341f4e958963dc6f70c0519"}
Nov 02 17:57:45.164300 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.164254    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main" containerID="cri-o://4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492" gracePeriod=45
Nov 02 17:57:45.187185 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.187147    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main" containerID="cri-o://7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3" gracePeriod=45
Nov 02 17:57:45.306949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.306915    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:45.487792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.487179    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\" (UniqueName: \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\") pod \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") "
Nov 02 17:57:45.487792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.487239    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\") pod \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") "
Nov 02 17:57:45.487792 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.487459    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\") pod \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\" (UID: \"2431bef3-ad2c-4304-83ed-41cf2b404fa7\") "
Nov 02 17:57:45.492658 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.489741    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca" pod "2431bef3-ad2c-4304-83ed-41cf2b404fa7" (UID: "2431bef3-ad2c-4304-83ed-41cf2b404fa7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:57:45.497026 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.497001    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k" pod "2431bef3-ad2c-4304-83ed-41cf2b404fa7" (UID: "2431bef3-ad2c-4304-83ed-41cf2b404fa7"). InnerVolumeSpecName "kube-api-access-jlw2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:45.497545 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.497520    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca" pod "2431bef3-ad2c-4304-83ed-41cf2b404fa7" (UID: "2431bef3-ad2c-4304-83ed-41cf2b404fa7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:45.532911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.532655    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:57:45.536830 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.536340    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:57:45.591265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.591185    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.591265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.591215    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlw2k\" (UniqueName: \"kubernetes.io/projected/2431bef3-ad2c-4304-83ed-41cf2b404fa7-kube-api-access-jlw2k\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.591265 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.591226    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2431bef3-ad2c-4304-83ed-41cf2b404fa7-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695381    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\" (UniqueName: \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695469    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\" (UniqueName: \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695527    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695577    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695635    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695693    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\" (UniqueName: \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695738    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.695862 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695806    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.696411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695907    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.696411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695947    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\") pod \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\" (UID: \"77f0e0b7-d25d-478f-9e6d-4a8ee454f206\") "
Nov 02 17:57:45.696411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.695998    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.696411 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.696128    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\") pod \"e6d643c2-7076-4970-8474-0f0ec75da35a\" (UID: \"e6d643c2-7076-4970-8474-0f0ec75da35a\") "
Nov 02 17:57:45.726214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.726175    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.726776 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.726752    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.726995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.726950    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.727126 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.727104    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.727333 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.727298    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.727468 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.727448    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.729244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.728728    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "kube-api-access-78xbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:45.732133 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.731898    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.738196 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.738064    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:57:45.738196 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.738162    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:45.738394 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.738256    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn" pod "77f0e0b7-d25d-478f-9e6d-4a8ee454f206" (UID: "77f0e0b7-d25d-478f-9e6d-4a8ee454f206"). InnerVolumeSpecName "kube-api-access-nrrpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:57:45.745807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.745728    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs" pod "e6d643c2-7076-4970-8474-0f0ec75da35a" (UID: "e6d643c2-7076-4970-8474-0f0ec75da35a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:57:45.798098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798064    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d643c2-7076-4970-8474-0f0ec75da35a-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798092    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798102    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798111    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798120    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78xbn\" (UniqueName: \"kubernetes.io/projected/e6d643c2-7076-4970-8474-0f0ec75da35a-kube-api-access-78xbn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798130    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798138    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798145    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6d643c2-7076-4970-8474-0f0ec75da35a-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798152    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798160    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrrpn\" (UniqueName: \"kubernetes.io/projected/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-kube-api-access-nrrpn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798167    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.798321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:45.798176    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f0e0b7-d25d-478f-9e6d-4a8ee454f206-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:57:45.836757 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:45.836717    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:57:46.015391 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.015353    5054 generic.go:356] "Generic (PLEG): container finished" podID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerID="4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492" exitCode=0
Nov 02 17:57:46.015565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.015398    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"
Nov 02 17:57:46.015565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.015436    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" event={"ID":"77f0e0b7-d25d-478f-9e6d-4a8ee454f206","Type":"ContainerDied","Data":"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"}
Nov 02 17:57:46.015565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.015478    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp" event={"ID":"77f0e0b7-d25d-478f-9e6d-4a8ee454f206","Type":"ContainerDied","Data":"2dedbfebf2a5e77a01a7fbcaa1f8ea66f5a7ef19dcf35fc8ddb89cfb1d51b401"}
Nov 02 17:57:46.015565 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.015501    5054 scope.go:122] "RemoveContainer" containerID="4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"
Nov 02 17:57:46.017164 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.017137    5054 generic.go:356] "Generic (PLEG): container finished" podID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerID="7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3" exitCode=0
Nov 02 17:57:46.017299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.017190    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"
Nov 02 17:57:46.017299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.017230    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" event={"ID":"e6d643c2-7076-4970-8474-0f0ec75da35a","Type":"ContainerDied","Data":"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"}
Nov 02 17:57:46.017299 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.017272    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn" event={"ID":"e6d643c2-7076-4970-8474-0f0ec75da35a","Type":"ContainerDied","Data":"19b7fdc517790f60e24ef48bee32e084cd83895f2ce58e0e7a8931213e76a7bf"}
Nov 02 17:57:46.018828 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.018796    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4" event={"ID":"2431bef3-ad2c-4304-83ed-41cf2b404fa7","Type":"ContainerDied","Data":"0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392"}
Nov 02 17:57:46.018939 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.018803    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"
Nov 02 17:57:46.018939 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.018869    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0775560ab94ecbb32c46f9706fc1d31ff996ff77f001dc44582149d51c822392"
Nov 02 17:57:46.029098 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.029075    5054 scope.go:122] "RemoveContainer" containerID="4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"
Nov 02 17:57:46.029404 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:46.029384    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492\": container with ID starting with 4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492 not found: ID does not exist" containerID="4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"
Nov 02 17:57:46.029481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.029412    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492"} err="failed to get container status \"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492\": rpc error: code = NotFound desc = could not find container \"4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492\": container with ID starting with 4ce25728e9763de36f95b12b57bc4b2e1d5be6b1d631c412540bf10a3a4b0492 not found: ID does not exist"
Nov 02 17:57:46.029481 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.029434    5054 scope.go:122] "RemoveContainer" containerID="7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"
Nov 02 17:57:46.039005 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.038937    5054 scope.go:122] "RemoveContainer" containerID="7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"
Nov 02 17:57:46.039237 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:57:46.039218    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3\": container with ID starting with 7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3 not found: ID does not exist" containerID="7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"
Nov 02 17:57:46.039293 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.039249    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3"} err="failed to get container status \"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3\": rpc error: code = NotFound desc = could not find container \"7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3\": container with ID starting with 7a7431fbc50ced9bd320dddaa0e52a6cff715b3eb6396ea3cc1320d23058b8e3 not found: ID does not exist"
Nov 02 17:57:46.051969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.051927    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:57:46.058181 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.058157    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/distinct-w1-9dfa27-kserve-fd7cc5599-flgjp"]
Nov 02 17:57:46.076089 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.076065    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:57:46.084035 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.084011    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-9dfa27/simulator-w1-9dfa27-kserve-7475c8f4b9-9grzn"]
Nov 02 17:57:46.619117 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.619082    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" path="/var/lib/kubelet/pods/77f0e0b7-d25d-478f-9e6d-4a8ee454f206/volumes"
Nov 02 17:57:46.619595 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:46.619571    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" path="/var/lib/kubelet/pods/e6d643c2-7076-4970-8474-0f0ec75da35a/volumes"
Nov 02 17:57:48.836132 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:48.836094    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 17:57:58.861831 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:57:58.857945    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 17:58:00.780613 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.780585    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:58:00.801222 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.801190    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\" (UniqueName: \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\") pod \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") "
Nov 02 17:58:00.801383 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.801309    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\") pod \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\" (UID: \"8665639b-ebac-41b8-b9d9-f42f1ea6d496\") "
Nov 02 17:58:00.802248 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.802221    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume" pod "8665639b-ebac-41b8-b9d9-f42f1ea6d496" (UID: "8665639b-ebac-41b8-b9d9-f42f1ea6d496"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:00.804330 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.804305    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc" pod "8665639b-ebac-41b8-b9d9-f42f1ea6d496" (UID: "8665639b-ebac-41b8-b9d9-f42f1ea6d496"). InnerVolumeSpecName "kube-api-access-kzwgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:00.903255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.903228    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzwgc\" (UniqueName: \"kubernetes.io/projected/8665639b-ebac-41b8-b9d9-f42f1ea6d496-kube-api-access-kzwgc\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:00.903255 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:00.903253    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8665639b-ebac-41b8-b9d9-f42f1ea6d496-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:01.176685 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.176650    5054 generic.go:356] "Generic (PLEG): container finished" podID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerID="a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996" exitCode=0
Nov 02 17:58:01.176925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.176712    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"
Nov 02 17:58:01.176925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.176727    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" event={"ID":"8665639b-ebac-41b8-b9d9-f42f1ea6d496","Type":"ContainerDied","Data":"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"}
Nov 02 17:58:01.176925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.176814    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx" event={"ID":"8665639b-ebac-41b8-b9d9-f42f1ea6d496","Type":"ContainerDied","Data":"2dbb5396369a8977b3333bbe9b83553130d764c0cc889ad3ea2c39e870ee0f59"}
Nov 02 17:58:01.176925 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.176883    5054 scope.go:122] "RemoveContainer" containerID="a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"
Nov 02 17:58:01.188934 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.188911    5054 scope.go:122] "RemoveContainer" containerID="a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"
Nov 02 17:58:01.189298 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:01.189268    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996\": container with ID starting with a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996 not found: ID does not exist" containerID="a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"
Nov 02 17:58:01.189422 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.189307    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996"} err="failed to get container status \"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996\": rpc error: code = NotFound desc = could not find container \"a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996\": container with ID starting with a2831e0f30cdf3ab11e30b35ce20b008ef77be628bc0f2fdc5d8c975a2415996 not found: ID does not exist"
Nov 02 17:58:01.205184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.205163    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:58:01.208417 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:01.208395    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9dfa27-56bd8ccd47-jq2nx"]
Nov 02 17:58:02.570789 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:02.570752    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:58:02.664860 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:02.661443    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" path="/var/lib/kubelet/pods/8665639b-ebac-41b8-b9d9-f42f1ea6d496/volumes"
Nov 02 17:58:05.230392 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.230356    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:58:05.231261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.231223    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" podUID="0601ac49-9bab-4da7-ac08-b517f90a7be5" containerName="maas-api" containerID="cri-o://8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6" gracePeriod=30
Nov 02 17:58:05.339075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.334450    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:58:05.339075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.334729    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy" containerID="cri-o://96a162780ad54e4c506553445304ebeca5993f710a2b0688a51654e9d78b65f2" gracePeriod=30
Nov 02 17:58:05.339769 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.339736    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:58:05.340025 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.339999    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy" containerID="cri-o://383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96" gracePeriod=30
Nov 02 17:58:05.350379 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.350354    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:58:05.350582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.350559    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy" containerID="cri-o://7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd" gracePeriod=30
Nov 02 17:58:05.792448 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.792402    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:58:05.812796 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.812758    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\") pod \"0601ac49-9bab-4da7-ac08-b517f90a7be5\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") "
Nov 02 17:58:05.814087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.813551    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\" (UniqueName: \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\") pod \"0601ac49-9bab-4da7-ac08-b517f90a7be5\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") "
Nov 02 17:58:05.814087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.813640    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\") pod \"0601ac49-9bab-4da7-ac08-b517f90a7be5\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") "
Nov 02 17:58:05.814087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.813744    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\") pod \"0601ac49-9bab-4da7-ac08-b517f90a7be5\" (UID: \"0601ac49-9bab-4da7-ac08-b517f90a7be5\") "
Nov 02 17:58:05.814302 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.814097    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca" pod "0601ac49-9bab-4da7-ac08-b517f90a7be5" (UID: "0601ac49-9bab-4da7-ac08-b517f90a7be5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:05.814364 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.814304    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0601ac49-9bab-4da7-ac08-b517f90a7be5-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:05.815656 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.815633    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls" pod "0601ac49-9bab-4da7-ac08-b517f90a7be5" (UID: "0601ac49-9bab-4da7-ac08-b517f90a7be5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:58:05.816087 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.816047    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq" pod "0601ac49-9bab-4da7-ac08-b517f90a7be5" (UID: "0601ac49-9bab-4da7-ac08-b517f90a7be5"). InnerVolumeSpecName "kube-api-access-8j5wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:05.816750 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.816721    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs" pod "0601ac49-9bab-4da7-ac08-b517f90a7be5" (UID: "0601ac49-9bab-4da7-ac08-b517f90a7be5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:58:05.915921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.915885    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:05.915921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.915918    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j5wq\" (UniqueName: \"kubernetes.io/projected/0601ac49-9bab-4da7-ac08-b517f90a7be5-kube-api-access-8j5wq\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:05.915921 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:05.915929    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0601ac49-9bab-4da7-ac08-b517f90a7be5-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:06.240171 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.240139    5054 generic.go:356] "Generic (PLEG): container finished" podID="0601ac49-9bab-4da7-ac08-b517f90a7be5" containerID="8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6" exitCode=0
Nov 02 17:58:06.240671 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.240185    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" event={"ID":"0601ac49-9bab-4da7-ac08-b517f90a7be5","Type":"ContainerDied","Data":"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"}
Nov 02 17:58:06.240671 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.240191    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"
Nov 02 17:58:06.240671 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.240227    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6" event={"ID":"0601ac49-9bab-4da7-ac08-b517f90a7be5","Type":"ContainerDied","Data":"665a62e4b3694e245bcc70f7fc3aac640ecc62a9e7d1e151f0d12341096c384d"}
Nov 02 17:58:06.240671 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.240250    5054 scope.go:122] "RemoveContainer" containerID="8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"
Nov 02 17:58:06.251954 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.251931    5054 scope.go:122] "RemoveContainer" containerID="8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"
Nov 02 17:58:06.252211 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:06.252192    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6\": container with ID starting with 8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6 not found: ID does not exist" containerID="8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"
Nov 02 17:58:06.252276 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.252223    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6"} err="failed to get container status \"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6\": rpc error: code = NotFound desc = could not find container \"8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6\": container with ID starting with 8a3e4af0a69eb5a5693f24ae8bcf2321578feabe2a505a590cbce021ec89d1e6 not found: ID does not exist"
Nov 02 17:58:06.266295 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.266263    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:58:06.275463 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.275430    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2a295c-59cc5d9bdb-shsl6"]
Nov 02 17:58:06.632931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:06.632469    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0601ac49-9bab-4da7-ac08-b517f90a7be5" path="/var/lib/kubelet/pods/0601ac49-9bab-4da7-ac08-b517f90a7be5/volumes"
Nov 02 17:58:10.864873 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:10.862789    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:58:11.006922 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.006894    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:58:11.016043 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.014769    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016262    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016360    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016399    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016434    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016472    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016505    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016550    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016586    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016620    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016651    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016678    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016711    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016807    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016880    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016911    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\") pod \"39c94d44-38ea-45da-b096-667b62bf9f35\" (UID: \"39c94d44-38ea-45da-b096-667b62bf9f35\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.016978    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.017979 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.017016    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\") pod \"46f7ddb6-ca43-483f-b162-348cb611ff8b\" (UID: \"46f7ddb6-ca43-483f-b162-348cb611ff8b\") "
Nov 02 17:58:11.019711 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.019235    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.020226 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.019967    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:11.020673 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.020379    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.073692 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.073649    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.086182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.084324    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.086182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.084528    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.086182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.084718    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.086182 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.085875    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:11.086518 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.086215    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.160387    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161644    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39c94d44-38ea-45da-b096-667b62bf9f35-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161674    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161689    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161703    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f7ddb6-ca43-483f-b162-348cb611ff8b-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161718    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161733    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161748    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161764    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161779    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.162161 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.161792    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.215253 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.215190    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "kube-api-access-br9x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.227931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.222007    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.227931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.222103    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.227931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.222159    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:11.227931 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.222209    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:11.242218 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.241329    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "kube-api-access-6m58n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.242218 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.241769    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy" pod "39c94d44-38ea-45da-b096-667b62bf9f35" (UID: "39c94d44-38ea-45da-b096-667b62bf9f35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.255156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.255092    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy" pod "46f7ddb6-ca43-483f-b162-348cb611ff8b" (UID: "46f7ddb6-ca43-483f-b162-348cb611ff8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265389    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39c94d44-38ea-45da-b096-667b62bf9f35-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265426    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m58n\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-kube-api-access-6m58n\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265444    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265458    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265472    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265486    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39c94d44-38ea-45da-b096-667b62bf9f35-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265502    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br9x8\" (UniqueName: \"kubernetes.io/projected/39c94d44-38ea-45da-b096-667b62bf9f35-kube-api-access-br9x8\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.265558 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.265516    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f7ddb6-ca43-483f-b162-348cb611ff8b-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.285288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.284035    5054 generic.go:356] "Generic (PLEG): container finished" podID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerID="383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96" exitCode=0
Nov 02 17:58:11.285288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.284141    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" event={"ID":"46f7ddb6-ca43-483f-b162-348cb611ff8b","Type":"ContainerDied","Data":"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"}
Nov 02 17:58:11.285288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.284194    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj" event={"ID":"46f7ddb6-ca43-483f-b162-348cb611ff8b","Type":"ContainerDied","Data":"c06f2ec8b6cd5abd4ff47805bebe34f2e50e9852cd9b254712c3b9f728c1f255"}
Nov 02 17:58:11.285288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.284224    5054 scope.go:122] "RemoveContainer" containerID="383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"
Nov 02 17:58:11.285288 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.284379    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"
Nov 02 17:58:11.290510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.289290    5054 generic.go:356] "Generic (PLEG): container finished" podID="39c94d44-38ea-45da-b096-667b62bf9f35" containerID="7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd" exitCode=0
Nov 02 17:58:11.290510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.289432    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" event={"ID":"39c94d44-38ea-45da-b096-667b62bf9f35","Type":"ContainerDied","Data":"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"}
Nov 02 17:58:11.290510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.289513    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l" event={"ID":"39c94d44-38ea-45da-b096-667b62bf9f35","Type":"ContainerDied","Data":"6be946a21cbd6e23aa55fb8523669d7912e13d3c8bf0bb2899d5df8233ef7b1f"}
Nov 02 17:58:11.290510 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.289591    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"
Nov 02 17:58:11.294867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.292026    5054 generic.go:356] "Generic (PLEG): container finished" podID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerID="96a162780ad54e4c506553445304ebeca5993f710a2b0688a51654e9d78b65f2" exitCode=0
Nov 02 17:58:11.294867 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.292107    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" event={"ID":"e180d7f9-4e30-4441-bd7f-7837dd79a063","Type":"ContainerDied","Data":"96a162780ad54e4c506553445304ebeca5993f710a2b0688a51654e9d78b65f2"}
Nov 02 17:58:11.299944 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.299825    5054 scope.go:122] "RemoveContainer" containerID="383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"
Nov 02 17:58:11.300660 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:11.300634    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96\": container with ID starting with 383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96 not found: ID does not exist" containerID="383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"
Nov 02 17:58:11.300747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.300675    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96"} err="failed to get container status \"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96\": rpc error: code = NotFound desc = could not find container \"383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96\": container with ID starting with 383c2a258a5c41be7595775c015fd7f0454385a5f9374036378e60b410a3ac96 not found: ID does not exist"
Nov 02 17:58:11.300747 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.300694    5054 scope.go:122] "RemoveContainer" containerID="7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"
Nov 02 17:58:11.316528 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.316405    5054 scope.go:122] "RemoveContainer" containerID="7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"
Nov 02 17:58:11.316823 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:11.316799    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd\": container with ID starting with 7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd not found: ID does not exist" containerID="7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"
Nov 02 17:58:11.317041 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.317003    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd"} err="failed to get container status \"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd\": rpc error: code = NotFound desc = could not find container \"7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd\": container with ID starting with 7843308ae914b646033bae951ba42592cda95d41d1c38a94d14c2b510e267acd not found: ID does not exist"
Nov 02 17:58:11.322581 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.322553    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:58:11.326999 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.326798    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-gzllj"]
Nov 02 17:58:11.342452 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.342420    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:58:11.353633 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.353573    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-x984l"]
Nov 02 17:58:11.445050 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.445026    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:58:11.467797 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.467765    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.467958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.467830    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.467958 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.467905    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.467972    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468078 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468017    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468125    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468145    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.468243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468160    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:11.468243 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468154    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468254    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.468456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468322    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468377    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.468456 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468411    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\") pod \"e180d7f9-4e30-4441-bd7f-7837dd79a063\" (UID: \"e180d7f9-4e30-4441-bd7f-7837dd79a063\") "
Nov 02 17:58:11.468673 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468647    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.469008 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.468984    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.469373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.469012    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.469373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.469027    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e180d7f9-4e30-4441-bd7f-7837dd79a063-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.469373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.469041    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.469373 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.469056    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.470480 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.470452    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "kube-api-access-jcj49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.470653 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.470633    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:11.470720 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.470672    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:11.470757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.470736    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy" pod "e180d7f9-4e30-4441-bd7f-7837dd79a063" (UID: "e180d7f9-4e30-4441-bd7f-7837dd79a063"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:11.570055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.570018    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.570055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.570052    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.570055 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.570062    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e180d7f9-4e30-4441-bd7f-7837dd79a063-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:11.570362 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:11.570073    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcj49\" (UniqueName: \"kubernetes.io/projected/e180d7f9-4e30-4441-bd7f-7837dd79a063-kube-api-access-jcj49\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:12.303997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.303964    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"
Nov 02 17:58:12.303997 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.303993    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k" event={"ID":"e180d7f9-4e30-4441-bd7f-7837dd79a063","Type":"ContainerDied","Data":"1d09b01bf86582aad8af0c07926d7c30dbafe57ff514287b1f954fd088d61f2a"}
Nov 02 17:58:12.304721 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.304078    5054 scope.go:122] "RemoveContainer" containerID="96a162780ad54e4c506553445304ebeca5993f710a2b0688a51654e9d78b65f2"
Nov 02 17:58:12.348232 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.348203    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:58:12.363937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.363901    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9dfa27-openshift-default-58b97f94c7-mv44k"]
Nov 02 17:58:12.617810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.617716    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" path="/var/lib/kubelet/pods/39c94d44-38ea-45da-b096-667b62bf9f35/volumes"
Nov 02 17:58:12.618378 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.618353    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" path="/var/lib/kubelet/pods/46f7ddb6-ca43-483f-b162-348cb611ff8b/volumes"
Nov 02 17:58:12.618932 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:12.618911    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" path="/var/lib/kubelet/pods/e180d7f9-4e30-4441-bd7f-7837dd79a063/volumes"
Nov 02 17:58:14.554709 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.554671    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:58:14.555214 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.554910    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy" containerID="cri-o://9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20" gracePeriod=30
Nov 02 17:58:14.560013 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.559983    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:58:14.560204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.560171    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy" containerID="cri-o://01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a" gracePeriod=30
Nov 02 17:58:14.662969 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.662770    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:58:14.664490 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:14.663097    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" containerID="cri-o://debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5" gracePeriod=30
Nov 02 17:58:15.836825 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:15.836787    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:58:16.585275 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:16.585239    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:58:18.055548 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:18.055511    5054 patch_prober.go:29] interesting pod/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 17:58:18.055953 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:18.055568    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 17:58:19.882733 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.882695    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:58:19.892123 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.892097    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:58:19.972382 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.971548    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:58:19.995605 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995571    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.995807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995631    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.995807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995667    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.995807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995699    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.995807 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995730    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995813    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995925    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.996068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.995938    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996068 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996016    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996077    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996166    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996195    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996238    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996273    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996315    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996338 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996344    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996415    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996477    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.996966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996504    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\") pod \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\" (UID: \"fbdd5ce0-9640-4b71-be42-d7db9d3e9533\") "
Nov 02 17:58:19.996966 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.996555    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\") pod \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\" (UID: \"b05e7c32-f16c-42cb-ab80-7b18b7b7746b\") "
Nov 02 17:58:19.997203 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.997114    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:19.997203 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.997135    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.997627    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.997884    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998002    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998095    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998289    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998366    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:19.998757 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998471    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:19.999365 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:19.998785    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.006454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.006422    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:20.006454 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.006438    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.007047 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.007021    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "kube-api-access-2qgps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.007487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.007435    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.007654 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.007630    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "kube-api-access-d7k2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.007871 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.007799    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:20.007995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.007973    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy" pod "fbdd5ce0-9640-4b71-be42-d7db9d3e9533" (UID: "fbdd5ce0-9640-4b71-be42-d7db9d3e9533"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.011102 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.011076    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy" pod "b05e7c32-f16c-42cb-ab80-7b18b7b7746b" (UID: "b05e7c32-f16c-42cb-ab80-7b18b7b7746b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.098156 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098122    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098233    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098275    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098321 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098305    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098431    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098500 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098487    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098706 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098685    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.098909 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098423    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.099038 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.099019    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.099215 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.099197    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\") pod \"0f955e31-53cd-4d5a-9c99-963e15579040\" (UID: \"0f955e31-53cd-4d5a-9c99-963e15579040\") "
Nov 02 17:58:20.099622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.098960    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.099622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.099222    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.099622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.099504    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 17:58:20.099622 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.099593    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.100104 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100084    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7k2n\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-kube-api-access-d7k2n\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100108    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100122    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100135    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100149    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qgps\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-kube-api-access-2qgps\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100162    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100176    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100188    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100201    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f955e31-53cd-4d5a-9c99-963e15579040-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100213    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100226    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100239    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100254 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100251    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100266    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100279    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100291    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100306    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100320    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100333    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdd5ce0-9640-4b71-be42-d7db9d3e9533-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100346    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.100739 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.100361    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b05e7c32-f16c-42cb-ab80-7b18b7b7746b-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.101325 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.101284    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.101509 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.101483    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "kube-api-access-84wjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:58:20.101919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.101896    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:58:20.101919 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.101902    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo" pod "0f955e31-53cd-4d5a-9c99-963e15579040" (UID: "0f955e31-53cd-4d5a-9c99-963e15579040"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 17:58:20.201112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.201080    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84wjk\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-kube-api-access-84wjk\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.201112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.201110    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f955e31-53cd-4d5a-9c99-963e15579040-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.201317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.201125    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f955e31-53cd-4d5a-9c99-963e15579040-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.201317 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.201137    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f955e31-53cd-4d5a-9c99-963e15579040-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:58:20.378809 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.378715    5054 generic.go:356] "Generic (PLEG): container finished" podID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerID="01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a" exitCode=0
Nov 02 17:58:20.378809 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.378781    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"
Nov 02 17:58:20.379075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.378801    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerDied","Data":"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"}
Nov 02 17:58:20.379075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.378926    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg" event={"ID":"b05e7c32-f16c-42cb-ab80-7b18b7b7746b","Type":"ContainerDied","Data":"e2cd85af8546c13662c5f1b3f7d7a6ff42555e82f10f20271737c7805ed615bb"}
Nov 02 17:58:20.379075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.378967    5054 scope.go:122] "RemoveContainer" containerID="01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"
Nov 02 17:58:20.380825 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.380799    5054 generic.go:356] "Generic (PLEG): container finished" podID="0f955e31-53cd-4d5a-9c99-963e15579040" containerID="debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5" exitCode=0
Nov 02 17:58:20.380940 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.380861    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" event={"ID":"0f955e31-53cd-4d5a-9c99-963e15579040","Type":"ContainerDied","Data":"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"}
Nov 02 17:58:20.380940 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.380915    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk" event={"ID":"0f955e31-53cd-4d5a-9c99-963e15579040","Type":"ContainerDied","Data":"d869d7540d25009c5bc9feade89ae2aecaa5b1844f722c481b40635a861dd4d5"}
Nov 02 17:58:20.381413 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.381383    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"
Nov 02 17:58:20.385462 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.385437    5054 generic.go:356] "Generic (PLEG): container finished" podID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerID="9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20" exitCode=0
Nov 02 17:58:20.385587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.385471    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" event={"ID":"fbdd5ce0-9640-4b71-be42-d7db9d3e9533","Type":"ContainerDied","Data":"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"}
Nov 02 17:58:20.385587 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.385497    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv" event={"ID":"fbdd5ce0-9640-4b71-be42-d7db9d3e9533","Type":"ContainerDied","Data":"26f599040d6c41226d4fdc10d9a1942989a56f54a48119096d301abbe3981553"}
Nov 02 17:58:20.385912 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.385896    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"
Nov 02 17:58:20.392690 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.392669    5054 scope.go:122] "RemoveContainer" containerID="a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"
Nov 02 17:58:20.405441 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.405414    5054 scope.go:122] "RemoveContainer" containerID="01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"
Nov 02 17:58:20.405754 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:20.405735    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a\": container with ID starting with 01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a not found: ID does not exist" containerID="01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"
Nov 02 17:58:20.405810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.405763    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a"} err="failed to get container status \"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a\": rpc error: code = NotFound desc = could not find container \"01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a\": container with ID starting with 01e1295b6dc5af7a2027f01e00c16b5ea276d8fbe7802a1fc6eb9b95b688460a not found: ID does not exist"
Nov 02 17:58:20.405810 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.405780    5054 scope.go:122] "RemoveContainer" containerID="a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"
Nov 02 17:58:20.406074 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:20.406055    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97\": container with ID starting with a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97 not found: ID does not exist" containerID="a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"
Nov 02 17:58:20.406112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.406080    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97"} err="failed to get container status \"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97\": rpc error: code = NotFound desc = could not find container \"a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97\": container with ID starting with a0fdbf0557d2928e12723f23b8aa8322dd771547cf2c7a20c14a82621cc7eb97 not found: ID does not exist"
Nov 02 17:58:20.406112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.406097    5054 scope.go:122] "RemoveContainer" containerID="debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"
Nov 02 17:58:20.416812 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.416785    5054 scope.go:122] "RemoveContainer" containerID="debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"
Nov 02 17:58:20.417213 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:20.417192    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5\": container with ID starting with debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5 not found: ID does not exist" containerID="debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"
Nov 02 17:58:20.417318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.417225    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5"} err="failed to get container status \"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5\": rpc error: code = NotFound desc = could not find container \"debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5\": container with ID starting with debdc5534436b3c42ee7ccd93d42520faee27a8b4f007b07a91a4eea0b5b17f5 not found: ID does not exist"
Nov 02 17:58:20.417318 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.417249    5054 scope.go:122] "RemoveContainer" containerID="9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"
Nov 02 17:58:20.418736 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.418710    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:58:20.428519 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.428494    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-7v7nv"]
Nov 02 17:58:20.429445 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.429427    5054 scope.go:122] "RemoveContainer" containerID="9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"
Nov 02 17:58:20.429749 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:20.429728    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20\": container with ID starting with 9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20 not found: ID does not exist" containerID="9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"
Nov 02 17:58:20.429806 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.429753    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20"} err="failed to get container status \"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20\": rpc error: code = NotFound desc = could not find container \"9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20\": container with ID starting with 9963a2efe6e032233d556d0e3904616ea64195469a356db160da5d38ac349c20 not found: ID does not exist"
Nov 02 17:58:20.447016 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.446992    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:58:20.453886 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.453865    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-286cg"]
Nov 02 17:58:20.478134 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.478101    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:58:20.484280 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.484248    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2a295c-openshift-default-68d655ddb7-24mwk"]
Nov 02 17:58:20.618283 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.618251    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" path="/var/lib/kubelet/pods/0f955e31-53cd-4d5a-9c99-963e15579040/volumes"
Nov 02 17:58:20.618752 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.618737    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" path="/var/lib/kubelet/pods/b05e7c32-f16c-42cb-ab80-7b18b7b7746b/volumes"
Nov 02 17:58:20.619219 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:20.619205    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" path="/var/lib/kubelet/pods/fbdd5ce0-9640-4b71-be42-d7db9d3e9533/volumes"
Nov 02 17:58:44.001730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.001641    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 17:58:44.002489 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002465    5054 cpu_manager.go:414] "containerMap: removing container" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy"
Nov 02 17:58:44.002561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002492    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy"
Nov 02 17:58:44.002561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002515    5054 cpu_manager.go:414] "containerMap: removing container" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy"
Nov 02 17:58:44.002561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002523    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy"
Nov 02 17:58:44.002561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002537    5054 cpu_manager.go:414] "containerMap: removing container" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.002561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002544    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002571    5054 cpu_manager.go:414] "containerMap: removing container" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002578    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002591    5054 cpu_manager.go:414] "containerMap: removing container" podUID="2431bef3-ad2c-4304-83ed-41cf2b404fa7" containerName="revoke-keys"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002598    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2431bef3-ad2c-4304-83ed-41cf2b404fa7" containerName="revoke-keys"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002611    5054 cpu_manager.go:414] "containerMap: removing container" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002619    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002632    5054 cpu_manager.go:414] "containerMap: removing container" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002639    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002653    5054 cpu_manager.go:414] "containerMap: removing container" podUID="0601ac49-9bab-4da7-ac08-b517f90a7be5" containerName="maas-api"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002668    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0601ac49-9bab-4da7-ac08-b517f90a7be5" containerName="maas-api"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002684    5054 cpu_manager.go:414] "containerMap: removing container" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002691    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002702    5054 cpu_manager.go:414] "containerMap: removing container" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002711    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80eaa7fa-1abd-4aa2-929a-eee6da1869c1" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002732    5054 cpu_manager.go:414] "containerMap: removing container" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002739    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002751    5054 cpu_manager.go:414] "containerMap: removing container" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002757    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002777    5054 cpu_manager.go:414] "containerMap: removing container" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002785    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002802    5054 cpu_manager.go:414] "containerMap: removing container" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.002814 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002812    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.002995    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003018    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbdd5ce0-9640-4b71-be42-d7db9d3e9533" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003027    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="e180d7f9-4e30-4441-bd7f-7837dd79a063" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003037    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="b05e7c32-f16c-42cb-ab80-7b18b7b7746b" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003051    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c94d44-38ea-45da-b096-667b62bf9f35" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003063    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="2431bef3-ad2c-4304-83ed-41cf2b404fa7" containerName="revoke-keys"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003071    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="8665639b-ebac-41b8-b9d9-f42f1ea6d496" containerName="payload-pre-processing"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003079    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="0601ac49-9bab-4da7-ac08-b517f90a7be5" containerName="maas-api"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003086    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f955e31-53cd-4d5a-9c99-963e15579040" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003096    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="77f0e0b7-d25d-478f-9e6d-4a8ee454f206" containerName="main"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003104    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="46f7ddb6-ca43-483f-b162-348cb611ff8b" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003115    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="28ac0470-6653-4011-ade7-6539315c395b" containerName="istio-proxy"
Nov 02 17:58:44.003890 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.003123    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6d643c2-7076-4970-8474-0f0ec75da35a" containerName="main"
Nov 02 17:58:44.006725 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.006705    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.012765 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.012743    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-263a5ecf-openshift-default-dockercfg-7jb6s\""
Nov 02 17:58:44.022065 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.022039    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 17:58:44.086706 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.086666    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.086937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.086721    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.086937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.086795    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.086937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.086851    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.086937 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.086871    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.087194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.087018    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.087194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.087105    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.087194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.087178    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnb6\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.087355 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.087261    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190385    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190448    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190507    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnb6\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190568    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190689    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190737    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190764    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190808    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.190859 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.190850    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.191588 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.191516    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.209984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.192473    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.209984 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.209758    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.210286 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.210230    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.210802 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.210751    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.213636 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.213615    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.230559 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.227827    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.230559 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.229417    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnb6\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.265075 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.255555    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\") pod \"e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") " pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.323762 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.323727    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:44.616561 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:58:44.616527    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4579446b_2ff3_4f17_ae15_1310d427a921.slice/crio-eb809ee8ba5822894b7b2dd06f7759fe8a8687b6f0ee9a83856553bd24f5c333 WatchSource:0}: Error finding container eb809ee8ba5822894b7b2dd06f7759fe8a8687b6f0ee9a83856553bd24f5c333: Status 404 returned error can't find the container with id eb809ee8ba5822894b7b2dd06f7759fe8a8687b6f0ee9a83856553bd24f5c333
Nov 02 17:58:44.618852 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.618802    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:58:44.618949 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.618918    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:58:44.618991 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.618965    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:58:44.619716 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:44.619693    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 17:58:45.564099 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:45.564059    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerStarted","Data":"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"}
Nov 02 17:58:45.564507 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:45.564122    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerStarted","Data":"eb809ee8ba5822894b7b2dd06f7759fe8a8687b6f0ee9a83856553bd24f5c333"}
Nov 02 17:58:45.589930 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:45.589872    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podStartSLOduration=2.589856234 podStartE2EDuration="2.589856234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:58:45.586044438 +0000 UTC m=+1129.094806506" watchObservedRunningTime="2026-11-02 17:58:45.589856234 +0000 UTC m=+1129.098618294"
Nov 02 17:58:45.843270 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:58:45.843182    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:58:46.324489 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:46.324453    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:46.331017 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:46.330989    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:46.574911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:46.573829    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:46.575298 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:46.574974    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:58:49.732062 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.732023    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 17:58:49.736995 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.736957    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.746918 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.746891    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 17:58:49.754449 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.754421    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-263a5ecf-serving-cert\""
Nov 02 17:58:49.885582 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.885541    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfnvm\" (UniqueName: \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.885827 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.885798    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.885973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.885865    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.885973 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.885920    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.987767 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.987665    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.987988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.987792    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfnvm\" (UniqueName: \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.987988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.987903    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.987988 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.987926    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.988579 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.988545    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.990425 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.990404    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:49.990532 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:49.990472    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:50.013868 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.008679    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfnvm\" (UniqueName: \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\") pod \"maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:50.056678 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.056639    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:50.355195 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.355164    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 17:58:50.356111 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:58:50.356071    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fcae34_3692_4003_b84c_2e5e6ceb3511.slice/crio-3c4a27a689c267382be0e92589b3192cfb37e5d5fac20f1d1dbde487693bdfe0 WatchSource:0}: Error finding container 3c4a27a689c267382be0e92589b3192cfb37e5d5fac20f1d1dbde487693bdfe0: Status 404 returned error can't find the container with id 3c4a27a689c267382be0e92589b3192cfb37e5d5fac20f1d1dbde487693bdfe0
Nov 02 17:58:50.604487 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.604399    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" event={"ID":"42fcae34-3692-4003-b84c-2e5e6ceb3511","Type":"ContainerStarted","Data":"3c4a27a689c267382be0e92589b3192cfb37e5d5fac20f1d1dbde487693bdfe0"}
Nov 02 17:58:50.649904 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.649869    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 17:58:50.655107 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.655081    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.666523 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.666496    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 17:58:50.697832 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.697785    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-263a5ecf-dockercfg-prz55\""
Nov 02 17:58:50.755861 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.755098    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-263a5ecf\""
Nov 02 17:58:50.807348 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.807307    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.807561 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.807494    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkmn\" (UniqueName: \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.909204 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.909177    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.909387 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.909369    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkmn\" (UniqueName: \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.910194 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.910167    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.918474 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.918453    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkmn\" (UniqueName: \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\") pod \"payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") " pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:50.972959 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:50.972929    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:51.272885 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.272815    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 17:58:51.275153 ip-10-0-132-5 kubenswrapper[5054]: W1102 17:58:51.275115    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11572de4_2eb4_4ca3_99f0_bbfb3927d88f.slice/crio-dd121bc17bccc159e930529f5f5eb81c82eb119b9ef2bb78602d2e30d1d9c1f2 WatchSource:0}: Error finding container dd121bc17bccc159e930529f5f5eb81c82eb119b9ef2bb78602d2e30d1d9c1f2: Status 404 returned error can't find the container with id dd121bc17bccc159e930529f5f5eb81c82eb119b9ef2bb78602d2e30d1d9c1f2
Nov 02 17:58:51.612514 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.612424    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" event={"ID":"42fcae34-3692-4003-b84c-2e5e6ceb3511","Type":"ContainerStarted","Data":"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"}
Nov 02 17:58:51.612676 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.612606    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:58:51.614580 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.614554    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" event={"ID":"11572de4-2eb4-4ca3-99f0-bbfb3927d88f","Type":"ContainerStarted","Data":"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"}
Nov 02 17:58:51.614730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.614602    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:58:51.614730 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.614628    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" event={"ID":"11572de4-2eb4-4ca3-99f0-bbfb3927d88f","Type":"ContainerStarted","Data":"dd121bc17bccc159e930529f5f5eb81c82eb119b9ef2bb78602d2e30d1d9c1f2"}
Nov 02 17:58:51.642084 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.642043    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" podStartSLOduration=2.157569994 podStartE2EDuration="2.642029289s" totalImagesPullingTime="484.459295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:58:51.637169551 +0000 UTC m=+1135.145931617" watchObservedRunningTime="2026-11-02 17:58:51.642029289 +0000 UTC m=+1135.150791356"
Nov 02 17:58:51.658167 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:51.658120    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" podStartSLOduration=1.658109117 podStartE2EDuration="1.658109117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 17:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 17:58:51.656941782 +0000 UTC m=+1135.165703851" watchObservedRunningTime="2026-11-02 17:58:51.658109117 +0000 UTC m=+1135.166871184"
Nov 02 17:58:55.361267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:55.361229    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 17:58:57.628453 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:58:57.628417    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 17:59:02.624652 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:02.624617    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 17:59:05.793962 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.793930    5054 generic.go:356] "Generic (PLEG): container finished" podID="4579446b-2ff3-4f17-ae15-1310d427a921" containerID="e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b" exitCode=0
Nov 02 17:59:05.794405 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.794006    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerDied","Data":"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"}
Nov 02 17:59:05.794464 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.794449    5054 scope.go:122] "RemoveContainer" containerID="e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"
Nov 02 17:59:05.795911 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.795884    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:59:05.795985 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.795952    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:59:05.796022 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:05.795982    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 17:59:06.803489 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:06.803454    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerStarted","Data":"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"}
Nov 02 17:59:07.324005 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:07.323971    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:59:07.324261 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:07.324232    5054 patch_prober.go:29] interesting pod/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 17:59:07.324370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:07.324302    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 17:59:08.324107 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:08.324069    5054 patch_prober.go:29] interesting pod/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 17:59:08.324547 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:08.324125    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 17:59:09.324577 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:09.324542    5054 patch_prober.go:29] interesting pod/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 17:59:09.325017 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:09.324596    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 17:59:10.324926 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:10.324873    5054 patch_prober.go:29] interesting pod/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 17:59:10.325429 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:10.324956    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 17:59:11.325018 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:11.324984    5054 patch_prober.go:29] interesting pod/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 17:59:11.325466 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:11.325040    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 17:59:12.329044 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:12.329015    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:59:12.329499 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:12.329475    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:59:12.330267 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:12.330244    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 17:59:15.835756 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:59:15.835722    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:59:42.193283 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:42.193243    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:59:45.836222 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:59:45.836186    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 17:59:47.511393 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:47.511362    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 17:59:52.512536 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:52.512468    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing" containerID="cri-o://053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe" gracePeriod=25
Nov 02 17:59:56.842633 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:56.842604    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:59:56.845641 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:56.845618    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:59:56.850327 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:56.850302    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 17:59:56.853184 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:56.853167    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 17:59:57.215370 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.215325    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main" containerID="cri-o://339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53" gracePeriod=45
Nov 02 17:59:57.496719 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.496695    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:59:57.633650 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633619    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\" (UniqueName: \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.633819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633697    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\" (UniqueName: \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.633819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633757    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.633819 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633781    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.633951 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633898    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.634006 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.633949    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\") pod \"159635c0-61bb-4fb0-82c5-2d742da70884\" (UID: \"159635c0-61bb-4fb0-82c5-2d742da70884\") "
Nov 02 17:59:57.634112 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634090    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:59:57.634216 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634187    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:59:57.634278 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634201    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:59:57.634557 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634535    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:57.634664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634560    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:57.634664 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.634576    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:57.636244 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.636216    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 17:59:57.636448 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.636425    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 17:59:57.636551 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.636444    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w" pod "159635c0-61bb-4fb0-82c5-2d742da70884" (UID: "159635c0-61bb-4fb0-82c5-2d742da70884"). InnerVolumeSpecName "kube-api-access-mhj4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 17:59:57.736130 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.736035    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhj4w\" (UniqueName: \"kubernetes.io/projected/159635c0-61bb-4fb0-82c5-2d742da70884-kube-api-access-mhj4w\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:57.736130 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.736069    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159635c0-61bb-4fb0-82c5-2d742da70884-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:57.736130 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:57.736087    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159635c0-61bb-4fb0-82c5-2d742da70884-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 17:59:58.164620 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.164590    5054 generic.go:356] "Generic (PLEG): container finished" podID="159635c0-61bb-4fb0-82c5-2d742da70884" containerID="339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53" exitCode=0
Nov 02 17:59:58.165105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.164626    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" event={"ID":"159635c0-61bb-4fb0-82c5-2d742da70884","Type":"ContainerDied","Data":"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"}
Nov 02 17:59:58.165105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.164645    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"
Nov 02 17:59:58.165105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.164663    5054 scope.go:122] "RemoveContainer" containerID="339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"
Nov 02 17:59:58.165105 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.164653    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4" event={"ID":"159635c0-61bb-4fb0-82c5-2d742da70884","Type":"ContainerDied","Data":"21945e34bfafadb45786536a96f9b74a60848864bdf25af702755483c3a8ad6a"}
Nov 02 17:59:58.178554 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.178525    5054 scope.go:122] "RemoveContainer" containerID="339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"
Nov 02 17:59:58.178865 ip-10-0-132-5 kubenswrapper[5054]: E1102 17:59:58.178831    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53\": container with ID starting with 339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53 not found: ID does not exist" containerID="339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"
Nov 02 17:59:58.178927 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.178874    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53"} err="failed to get container status \"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53\": rpc error: code = NotFound desc = could not find container \"339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53\": container with ID starting with 339f396bc6cbacb362859cc8e969d58b933c61366536fa14f0931621edf9ed53 not found: ID does not exist"
Nov 02 17:59:58.196094 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.196062    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:59:58.200576 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.200548    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-ea752f/premium-w4-ea752f-kserve-87fc96db4-pwnd4"]
Nov 02 17:59:58.617998 ip-10-0-132-5 kubenswrapper[5054]: I1102 17:59:58.617925    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" path="/var/lib/kubelet/pods/159635c0-61bb-4fb0-82c5-2d742da70884/volumes"
Nov 02 18:00:00.171237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.171201    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:00.171909 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.171890    5054 cpu_manager.go:414] "containerMap: removing container" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main"
Nov 02 18:00:00.171909 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.171909    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main"
Nov 02 18:00:00.172047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.172024    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="159635c0-61bb-4fb0-82c5-2d742da70884" containerName="main"
Nov 02 18:00:00.177045 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.177022    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.197531 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.197501    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:00.265695 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.265660    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5sc2\" (UniqueName: \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.265887 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.265788    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.281294 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.281262    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:00:00.366783 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.366748    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5sc2\" (UniqueName: \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.367014 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.366916    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.367568 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.367547    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.375707 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.375676    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5sc2\" (UniqueName: \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\") pod \"maas-api-key-cleanup-29894040-q6rlc\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.495897 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.495794    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:00.818154 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:00.818070    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:00.821780 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:00:00.821750    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a117e54_fdd2_4ada_84a8_b9654dd451cf.slice/crio-489d9e1224389feb2590f0e96c2a0a452c93b36ba7e2cdcc217e0684e2b6be4f WatchSource:0}: Error finding container 489d9e1224389feb2590f0e96c2a0a452c93b36ba7e2cdcc217e0684e2b6be4f: Status 404 returned error can't find the container with id 489d9e1224389feb2590f0e96c2a0a452c93b36ba7e2cdcc217e0684e2b6be4f
Nov 02 18:00:01.195230 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:01.195186    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerStarted","Data":"01d1e516e968793a8bf07ea84b30189b83e8ccb82b8dfeec680d56527538176b"}
Nov 02 18:00:01.195715 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:01.195254    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerStarted","Data":"489d9e1224389feb2590f0e96c2a0a452c93b36ba7e2cdcc217e0684e2b6be4f"}
Nov 02 18:00:01.216232 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:01.216174    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" podStartSLOduration=1.216157554 podStartE2EDuration="1.216157554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:00:01.212135371 +0000 UTC m=+1204.720897438" watchObservedRunningTime="2026-11-02 18:00:01.216157554 +0000 UTC m=+1204.724919621"
Nov 02 18:00:01.765644 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:01.765606    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:00:01.858282 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:01.858238    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:00:02.205235 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:02.205200    5054 generic.go:356] "Generic (PLEG): container finished" podID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerID="01d1e516e968793a8bf07ea84b30189b83e8ccb82b8dfeec680d56527538176b" exitCode=60
Nov 02 18:00:02.205647 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:02.205281    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerDied","Data":"01d1e516e968793a8bf07ea84b30189b83e8ccb82b8dfeec680d56527538176b"}
Nov 02 18:00:02.205647 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:02.205589    5054 scope.go:122] "RemoveContainer" containerID="01d1e516e968793a8bf07ea84b30189b83e8ccb82b8dfeec680d56527538176b"
Nov 02 18:00:03.265625 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:03.265588    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerStarted","Data":"03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"}
Nov 02 18:00:04.276351 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:04.276317    5054 generic.go:356] "Generic (PLEG): container finished" podID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerID="03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e" exitCode=60
Nov 02 18:00:04.276820 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:04.276379    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerDied","Data":"03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"}
Nov 02 18:00:04.276820 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:04.276422    5054 scope.go:122] "RemoveContainer" containerID="01d1e516e968793a8bf07ea84b30189b83e8ccb82b8dfeec680d56527538176b"
Nov 02 18:00:04.276820 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:04.276701    5054 scope.go:122] "RemoveContainer" containerID="03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"
Nov 02 18:00:04.277074 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:04.277048    5054 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894040-q6rlc_odh-ai-gateway-infra(1a117e54-fdd2-4ada-84a8-b9654dd451cf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf"
Nov 02 18:00:05.285117 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:05.285089    5054 scope.go:122] "RemoveContainer" containerID="03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"
Nov 02 18:00:05.285557 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:05.285346    5054 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894040-q6rlc_odh-ai-gateway-infra(1a117e54-fdd2-4ada-84a8-b9654dd451cf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf"
Nov 02 18:00:11.858057 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:11.857955    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:00:12.461410 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.461377    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 18:00:12.461902 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.461859    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy" containerID="cri-o://3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff" gracePeriod=30
Nov 02 18:00:12.487260 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.487230    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 18:00:12.487457 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.487436    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy" containerID="cri-o://9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e" gracePeriod=30
Nov 02 18:00:12.494809 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.494780    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 18:00:12.495187 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.495154    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" containerID="cri-o://1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455" gracePeriod=30
Nov 02 18:00:12.813135 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.813091    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 18:00:12.898466 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.898429    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\") pod \"565063da-8069-4447-acf9-a39779f5b1eb\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") "
Nov 02 18:00:12.898935 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.898603    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\" (UniqueName: \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\") pod \"565063da-8069-4447-acf9-a39779f5b1eb\" (UID: \"565063da-8069-4447-acf9-a39779f5b1eb\") "
Nov 02 18:00:12.898935 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.898908    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume" pod "565063da-8069-4447-acf9-a39779f5b1eb" (UID: "565063da-8069-4447-acf9-a39779f5b1eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:12.899141 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.899123    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/565063da-8069-4447-acf9-a39779f5b1eb-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:12.900893 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.900866    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f" pod "565063da-8069-4447-acf9-a39779f5b1eb" (UID: "565063da-8069-4447-acf9-a39779f5b1eb"). InnerVolumeSpecName "kube-api-access-xpx5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:12.999962 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:12.999924    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpx5f\" (UniqueName: \"kubernetes.io/projected/565063da-8069-4447-acf9-a39779f5b1eb-kube-api-access-xpx5f\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:13.340276 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.340240    5054 generic.go:356] "Generic (PLEG): container finished" podID="565063da-8069-4447-acf9-a39779f5b1eb" containerID="053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe" exitCode=0
Nov 02 18:00:13.340464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.340284    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"
Nov 02 18:00:13.340464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.340316    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" event={"ID":"565063da-8069-4447-acf9-a39779f5b1eb","Type":"ContainerDied","Data":"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"}
Nov 02 18:00:13.340464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.340373    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv" event={"ID":"565063da-8069-4447-acf9-a39779f5b1eb","Type":"ContainerDied","Data":"d5e1f5168669f96dda79de646959a808c48b4906aedc3bb616b0c25ffadbc363"}
Nov 02 18:00:13.340464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.340397    5054 scope.go:122] "RemoveContainer" containerID="053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"
Nov 02 18:00:13.359398 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.359378    5054 scope.go:122] "RemoveContainer" containerID="053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"
Nov 02 18:00:13.359693 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:13.359673    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe\": container with ID starting with 053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe not found: ID does not exist" containerID="053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"
Nov 02 18:00:13.359760 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.359705    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe"} err="failed to get container status \"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe\": rpc error: code = NotFound desc = could not find container \"053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe\": container with ID starting with 053cf5ce019049831ce82d59e7427493720adb3532f29b0af19d649f577e6efe not found: ID does not exist"
Nov 02 18:00:13.369138 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.369113    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 18:00:13.374361 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.374335    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ea752f-695698d78c-n92lv"]
Nov 02 18:00:13.576128 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:13.576094    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:00:14.617112 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:14.617080    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="565063da-8069-4447-acf9-a39779f5b1eb" path="/var/lib/kubelet/pods/565063da-8069-4447-acf9-a39779f5b1eb/volumes"
Nov 02 18:00:15.220244 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:15.220209    5054 patch_prober.go:29] interesting pod/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 18:00:15.220426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:15.220263    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 18:00:15.837525 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:15.837486    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:00:16.613754 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:16.613727    5054 scope.go:122] "RemoveContainer" containerID="03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"
Nov 02 18:00:17.371400 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.371362    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerStarted","Data":"dee88d9ed97fcc4f680659ab167dff663889a215ce691345891c12349d7069f4"}
Nov 02 18:00:17.794488 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.794456    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 18:00:17.840346 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.840317    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 18:00:17.859175 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859148    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859309 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859191    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859309 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859225    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859309 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859263    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859309 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859292    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859326    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859354    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859383    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859444    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859527    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859560    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.859671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859577    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859671    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859746    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859783    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859827    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859901    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.860007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.859946    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\") pod \"dd10872f-54d6-46db-954f-ae6162ac8247\" (UID: \"dd10872f-54d6-46db-954f-ae6162ac8247\") "
Nov 02 18:00:17.860188 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860036    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\") pod \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\" (UID: \"da3621a8-307a-44ec-ab7e-c7d6459c5e9d\") "
Nov 02 18:00:17.860222 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860198    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.860411 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860393    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.860411 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860404    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.860616 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860597    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.860932 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.860910    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:17.861427 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.861406    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:17.861825 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.861802    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.862198 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862175    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.862622 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862606    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd10872f-54d6-46db-954f-ae6162ac8247-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.862788 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862772    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.862999 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862982    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.863110 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.863090    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.863115    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.863129    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.863144    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862415    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.862425    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.863214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.863062    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.865563 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.865277    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 18:00:17.865563 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.865398    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "kube-api-access-vrss7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.872280    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.872304    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.872310    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token" pod "da3621a8-307a-44ec-ab7e-c7d6459c5e9d" (UID: "da3621a8-307a-44ec-ab7e-c7d6459c5e9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.872326    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.872505    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "kube-api-access-slqkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.877899 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.874287    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo" pod "dd10872f-54d6-46db-954f-ae6162ac8247" (UID: "dd10872f-54d6-46db-954f-ae6162ac8247"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:00:17.964517 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964479    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.964682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964533    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.964682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964580    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.964682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964614    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.964890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964703    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.964890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964770    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.965134 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965106    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.965282 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965257    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.965409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964894    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.965409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.964951    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.965409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965037    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.965409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965045    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:17.965409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965334    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\") pod \"5847ab4b-c016-4075-a990-994effeda769\" (UID: \"5847ab4b-c016-4075-a990-994effeda769\") "
Nov 02 18:00:17.965855 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965806    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:17.965948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965906    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5847ab4b-c016-4075-a990-994effeda769-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.965948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965930    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.965948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965945    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965961    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965976    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.965991    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd10872f-54d6-46db-954f-ae6162ac8247-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966004    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966017    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966031    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slqkn\" (UniqueName: \"kubernetes.io/projected/dd10872f-54d6-46db-954f-ae6162ac8247-kube-api-access-slqkn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966046    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966059    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrss7\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-kube-api-access-vrss7\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966073    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3621a8-307a-44ec-ab7e-c7d6459c5e9d-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966088    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd10872f-54d6-46db-954f-ae6162ac8247-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.966161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.966101    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:17.967136 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.967106    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:00:17.967410 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.967390    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "kube-api-access-xsrgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.967826 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.967805    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:17.968856 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:17.968818    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy" pod "5847ab4b-c016-4075-a990-994effeda769" (UID: "5847ab4b-c016-4075-a990-994effeda769"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:00:18.067215 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.067176    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5847ab4b-c016-4075-a990-994effeda769-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:18.067215 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.067209    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:18.067215 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.067218    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:18.067452 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.067227    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5847ab4b-c016-4075-a990-994effeda769-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:18.067452 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.067237    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsrgs\" (UniqueName: \"kubernetes.io/projected/5847ab4b-c016-4075-a990-994effeda769-kube-api-access-xsrgs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:18.379215 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.379176    5054 generic.go:356] "Generic (PLEG): container finished" podID="5847ab4b-c016-4075-a990-994effeda769" containerID="1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455" exitCode=0
Nov 02 18:00:18.379697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.379223    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"
Nov 02 18:00:18.379697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.379263    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" event={"ID":"5847ab4b-c016-4075-a990-994effeda769","Type":"ContainerDied","Data":"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"}
Nov 02 18:00:18.379697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.379344    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc" event={"ID":"5847ab4b-c016-4075-a990-994effeda769","Type":"ContainerDied","Data":"4f85643a8f261e210245f8c04d6ae2a10839b14aad383707d31cd0be63d7353e"}
Nov 02 18:00:18.379697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.379370    5054 scope.go:122] "RemoveContainer" containerID="1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"
Nov 02 18:00:18.381083 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.381063    5054 generic.go:356] "Generic (PLEG): container finished" podID="dd10872f-54d6-46db-954f-ae6162ac8247" containerID="3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff" exitCode=0
Nov 02 18:00:18.381198 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.381113    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"
Nov 02 18:00:18.381198 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.381129    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" event={"ID":"dd10872f-54d6-46db-954f-ae6162ac8247","Type":"ContainerDied","Data":"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"}
Nov 02 18:00:18.381198 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.381181    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd" event={"ID":"dd10872f-54d6-46db-954f-ae6162ac8247","Type":"ContainerDied","Data":"0febfd1d21f7960f34ea3cb25d9af7052ff08797c9cfb26fb693035a21980489"}
Nov 02 18:00:18.383389 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.383368    5054 generic.go:356] "Generic (PLEG): container finished" podID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerID="dee88d9ed97fcc4f680659ab167dff663889a215ce691345891c12349d7069f4" exitCode=60
Nov 02 18:00:18.383541 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.383426    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerDied","Data":"dee88d9ed97fcc4f680659ab167dff663889a215ce691345891c12349d7069f4"}
Nov 02 18:00:18.383740 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.383722    5054 scope.go:122] "RemoveContainer" containerID="dee88d9ed97fcc4f680659ab167dff663889a215ce691345891c12349d7069f4"
Nov 02 18:00:18.384330 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:18.383993    5054 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29894040-q6rlc_odh-ai-gateway-infra(1a117e54-fdd2-4ada-84a8-b9654dd451cf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf"
Nov 02 18:00:18.386022 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.385998    5054 generic.go:356] "Generic (PLEG): container finished" podID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerID="9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e" exitCode=0
Nov 02 18:00:18.386142 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.386038    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"
Nov 02 18:00:18.386142 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.386093    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" event={"ID":"da3621a8-307a-44ec-ab7e-c7d6459c5e9d","Type":"ContainerDied","Data":"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"}
Nov 02 18:00:18.386142 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.386126    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd" event={"ID":"da3621a8-307a-44ec-ab7e-c7d6459c5e9d","Type":"ContainerDied","Data":"5bb17cdfea005c0b791a7caf18bbe98c3880fa957c3ed12a721f5fe0f97c4400"}
Nov 02 18:00:18.390930 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.390907    5054 scope.go:122] "RemoveContainer" containerID="1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"
Nov 02 18:00:18.391204 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:18.391182    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455\": container with ID starting with 1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455 not found: ID does not exist" containerID="1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"
Nov 02 18:00:18.391275 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.391211    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455"} err="failed to get container status \"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455\": rpc error: code = NotFound desc = could not find container \"1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455\": container with ID starting with 1c873bfe3a4bbb5c386eb5d33b792bb30005ce868d151ee458babe0753494455 not found: ID does not exist"
Nov 02 18:00:18.391275 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.391232    5054 scope.go:122] "RemoveContainer" containerID="3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"
Nov 02 18:00:18.404067 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.404031    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:18.405021 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.405000    5054 scope.go:122] "RemoveContainer" containerID="3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"
Nov 02 18:00:18.405338 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:18.405319    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff\": container with ID starting with 3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff not found: ID does not exist" containerID="3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"
Nov 02 18:00:18.405398 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.405348    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff"} err="failed to get container status \"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff\": rpc error: code = NotFound desc = could not find container \"3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff\": container with ID starting with 3d974520d18059124566395a2d3148de8582657b3893685561cc39282609faff not found: ID does not exist"
Nov 02 18:00:18.405398 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.405366    5054 scope.go:122] "RemoveContainer" containerID="03fb99db923d992f2ae7ce7b8979064e1b8131e2fcc6a7be4ddc5afbd849843e"
Nov 02 18:00:18.418636 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.418619    5054 scope.go:122] "RemoveContainer" containerID="9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"
Nov 02 18:00:18.431231 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.431210    5054 scope.go:122] "RemoveContainer" containerID="9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"
Nov 02 18:00:18.431502 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:18.431477    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e\": container with ID starting with 9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e not found: ID does not exist" containerID="9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"
Nov 02 18:00:18.431625 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.431512    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e"} err="failed to get container status \"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e\": rpc error: code = NotFound desc = could not find container \"9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e\": container with ID starting with 9b610be86a8efb4266d0dea6ff217cd3697d4c6c1f5404f642de04cbb9f90d7e not found: ID does not exist"
Nov 02 18:00:18.444026 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.444004    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 18:00:18.452562 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.452539    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-4cfdd"]
Nov 02 18:00:18.465704 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.465683    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 18:00:18.470114 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.470093    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-pvcwc"]
Nov 02 18:00:18.482373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.482350    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 18:00:18.488888 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.488868    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ea752f-openshift-default-549fb46797-nwgxd"]
Nov 02 18:00:18.617273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.617239    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5847ab4b-c016-4075-a990-994effeda769" path="/var/lib/kubelet/pods/5847ab4b-c016-4075-a990-994effeda769/volumes"
Nov 02 18:00:18.617726 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.617712    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" path="/var/lib/kubelet/pods/da3621a8-307a-44ec-ab7e-c7d6459c5e9d/volumes"
Nov 02 18:00:18.618195 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:18.618176    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" path="/var/lib/kubelet/pods/dd10872f-54d6-46db-954f-ae6162ac8247/volumes"
Nov 02 18:00:19.539645 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.539621    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:19.582781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.582732    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\" (UniqueName: \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\") pod \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") "
Nov 02 18:00:19.582990 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.582829    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\") pod \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\" (UID: \"1a117e54-fdd2-4ada-84a8-b9654dd451cf\") "
Nov 02 18:00:19.583260 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.583230    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca" pod "1a117e54-fdd2-4ada-84a8-b9654dd451cf" (UID: "1a117e54-fdd2-4ada-84a8-b9654dd451cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:19.583518 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.583499    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a117e54-fdd2-4ada-84a8-b9654dd451cf-maas-api-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:19.585827 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.585798    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2" pod "1a117e54-fdd2-4ada-84a8-b9654dd451cf" (UID: "1a117e54-fdd2-4ada-84a8-b9654dd451cf"). InnerVolumeSpecName "kube-api-access-z5sc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:19.684620 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:19.684575    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5sc2\" (UniqueName: \"kubernetes.io/projected/1a117e54-fdd2-4ada-84a8-b9654dd451cf-kube-api-access-z5sc2\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:20.405995 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.405960    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"
Nov 02 18:00:20.406179 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.405992    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc" event={"ID":"1a117e54-fdd2-4ada-84a8-b9654dd451cf","Type":"ContainerDied","Data":"489d9e1224389feb2590f0e96c2a0a452c93b36ba7e2cdcc217e0684e2b6be4f"}
Nov 02 18:00:20.406179 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.406056    5054 scope.go:122] "RemoveContainer" containerID="dee88d9ed97fcc4f680659ab167dff663889a215ce691345891c12349d7069f4"
Nov 02 18:00:20.436114 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.436078    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:20.444573 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.444547    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894040-q6rlc"]
Nov 02 18:00:20.628413 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:20.628369    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" path="/var/lib/kubelet/pods/1a117e54-fdd2-4ada-84a8-b9654dd451cf/volumes"
Nov 02 18:00:44.822362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:44.822322    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 18:00:44.823028 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:44.822591    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" podUID="42fcae34-3692-4003-b84c-2e5e6ceb3511" containerName="maas-api" containerID="cri-o://775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb" gracePeriod=30
Nov 02 18:00:44.891886 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:44.891853    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 18:00:45.191827 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.191797    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 18:00:45.288320 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.288272    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\" (UniqueName: \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\") pod \"42fcae34-3692-4003-b84c-2e5e6ceb3511\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") "
Nov 02 18:00:45.288533 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.288487    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\") pod \"42fcae34-3692-4003-b84c-2e5e6ceb3511\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") "
Nov 02 18:00:45.288632 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.288583    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\") pod \"42fcae34-3692-4003-b84c-2e5e6ceb3511\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") "
Nov 02 18:00:45.288700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.288632    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\") pod \"42fcae34-3692-4003-b84c-2e5e6ceb3511\" (UID: \"42fcae34-3692-4003-b84c-2e5e6ceb3511\") "
Nov 02 18:00:45.289462 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.289429    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca" pod "42fcae34-3692-4003-b84c-2e5e6ceb3511" (UID: "42fcae34-3692-4003-b84c-2e5e6ceb3511"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:45.291242 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.291217    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls" pod "42fcae34-3692-4003-b84c-2e5e6ceb3511" (UID: "42fcae34-3692-4003-b84c-2e5e6ceb3511"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:00:45.293481 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.293454    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs" pod "42fcae34-3692-4003-b84c-2e5e6ceb3511" (UID: "42fcae34-3692-4003-b84c-2e5e6ceb3511"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:00:45.297021 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.296992    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm" pod "42fcae34-3692-4003-b84c-2e5e6ceb3511" (UID: "42fcae34-3692-4003-b84c-2e5e6ceb3511"). InnerVolumeSpecName "kube-api-access-tfnvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:45.390120 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.390084    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:45.390120 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.390119    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42fcae34-3692-4003-b84c-2e5e6ceb3511-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:45.390396 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.390136    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42fcae34-3692-4003-b84c-2e5e6ceb3511-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:45.390396 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.390150    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfnvm\" (UniqueName: \"kubernetes.io/projected/42fcae34-3692-4003-b84c-2e5e6ceb3511-kube-api-access-tfnvm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:45.564181 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.564144    5054 generic.go:356] "Generic (PLEG): container finished" podID="42fcae34-3692-4003-b84c-2e5e6ceb3511" containerID="775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb" exitCode=0
Nov 02 18:00:45.564382 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.564193    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"
Nov 02 18:00:45.564382 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.564227    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" event={"ID":"42fcae34-3692-4003-b84c-2e5e6ceb3511","Type":"ContainerDied","Data":"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"}
Nov 02 18:00:45.564382 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.564279    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4" event={"ID":"42fcae34-3692-4003-b84c-2e5e6ceb3511","Type":"ContainerDied","Data":"3c4a27a689c267382be0e92589b3192cfb37e5d5fac20f1d1dbde487693bdfe0"}
Nov 02 18:00:45.564382 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.564301    5054 scope.go:122] "RemoveContainer" containerID="775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"
Nov 02 18:00:45.576008 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.575989    5054 scope.go:122] "RemoveContainer" containerID="775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"
Nov 02 18:00:45.576320 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:45.576298    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb\": container with ID starting with 775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb not found: ID does not exist" containerID="775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"
Nov 02 18:00:45.576378 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.576330    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb"} err="failed to get container status \"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb\": rpc error: code = NotFound desc = could not find container \"775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb\": container with ID starting with 775bf5761b0645f4c717f7e25a05b9dd2d377613b418d3d3ae65836b3a5abbcb not found: ID does not exist"
Nov 02 18:00:45.590171 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.590149    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 18:00:45.596574 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:45.596550    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-263a5ecf-65879dbcfc-6z8t4"]
Nov 02 18:00:45.837932 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:45.837854    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:00:46.616151 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:46.616123    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42fcae34-3692-4003-b84c-2e5e6ceb3511" path="/var/lib/kubelet/pods/42fcae34-3692-4003-b84c-2e5e6ceb3511/volumes"
Nov 02 18:00:47.665755 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:47.665718    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:00:49.892406 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:49.892366    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" podUID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" containerName="payload-processing" containerID="cri-o://cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c" gracePeriod=25
Nov 02 18:00:50.163451 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.163424    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 18:00:50.254024 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.253988    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\") pod \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") "
Nov 02 18:00:50.254228 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.254051    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\" (UniqueName: \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\") pod \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\" (UID: \"11572de4-2eb4-4ca3-99f0-bbfb3927d88f\") "
Nov 02 18:00:50.254426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.254405    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume" pod "11572de4-2eb4-4ca3-99f0-bbfb3927d88f" (UID: "11572de4-2eb4-4ca3-99f0-bbfb3927d88f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:00:50.257689 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.257658    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn" pod "11572de4-2eb4-4ca3-99f0-bbfb3927d88f" (UID: "11572de4-2eb4-4ca3-99f0-bbfb3927d88f"). InnerVolumeSpecName "kube-api-access-xbkmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:00:50.355627 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.355591    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:50.355627 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.355622    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbkmn\" (UniqueName: \"kubernetes.io/projected/11572de4-2eb4-4ca3-99f0-bbfb3927d88f-kube-api-access-xbkmn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:00:50.600981 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.600942    5054 generic.go:356] "Generic (PLEG): container finished" podID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" containerID="cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c" exitCode=0
Nov 02 18:00:50.600981 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.600987    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"
Nov 02 18:00:50.601214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.601025    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" event={"ID":"11572de4-2eb4-4ca3-99f0-bbfb3927d88f","Type":"ContainerDied","Data":"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"}
Nov 02 18:00:50.601214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.601086    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct" event={"ID":"11572de4-2eb4-4ca3-99f0-bbfb3927d88f","Type":"ContainerDied","Data":"dd121bc17bccc159e930529f5f5eb81c82eb119b9ef2bb78602d2e30d1d9c1f2"}
Nov 02 18:00:50.601214 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.601117    5054 scope.go:122] "RemoveContainer" containerID="cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"
Nov 02 18:00:50.613825 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.613804    5054 scope.go:122] "RemoveContainer" containerID="cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"
Nov 02 18:00:50.614170 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:00:50.614149    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c\": container with ID starting with cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c not found: ID does not exist" containerID="cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"
Nov 02 18:00:50.614248 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.614180    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c"} err="failed to get container status \"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c\": rpc error: code = NotFound desc = could not find container \"cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c\": container with ID starting with cfeb1c6da083ce06e2439fd3321629bd5319ec8ec8e149b60abe13dfe47fe03c not found: ID does not exist"
Nov 02 18:00:50.627614 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.627586    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 18:00:50.635430 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:50.635410    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-263a5ecf-5fbb76c8f7-fjbct"]
Nov 02 18:00:52.617102 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:00:52.617068    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" path="/var/lib/kubelet/pods/11572de4-2eb4-4ca3-99f0-bbfb3927d88f/volumes"
Nov 02 18:01:03.442161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:03.442127    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 18:01:03.442555 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:03.442427    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy" containerID="cri-o://37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f" gracePeriod=30
Nov 02 18:01:08.703059 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.703030    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 18:01:08.716964 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.716869    5054 generic.go:356] "Generic (PLEG): container finished" podID="4579446b-2ff3-4f17-ae15-1310d427a921" containerID="37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f" exitCode=0
Nov 02 18:01:08.718900 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.716975    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerDied","Data":"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"}
Nov 02 18:01:08.718900 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.717026    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7" event={"ID":"4579446b-2ff3-4f17-ae15-1310d427a921","Type":"ContainerDied","Data":"eb809ee8ba5822894b7b2dd06f7759fe8a8687b6f0ee9a83856553bd24f5c333"}
Nov 02 18:01:08.718900 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.717054    5054 scope.go:122] "RemoveContainer" containerID="37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"
Nov 02 18:01:08.718900 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.717267    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"
Nov 02 18:01:08.731998 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.731951    5054 scope.go:122] "RemoveContainer" containerID="e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"
Nov 02 18:01:08.741730 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.741710    5054 scope.go:122] "RemoveContainer" containerID="37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"
Nov 02 18:01:08.742055 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:08.742034    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f\": container with ID starting with 37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f not found: ID does not exist" containerID="37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"
Nov 02 18:01:08.742169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.742062    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f"} err="failed to get container status \"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f\": rpc error: code = NotFound desc = could not find container \"37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f\": container with ID starting with 37a006b67ad422642a4dea815ceb7a8dcd1cb8d108a3b812a911c619b8523b1f not found: ID does not exist"
Nov 02 18:01:08.742169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.742082    5054 scope.go:122] "RemoveContainer" containerID="e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"
Nov 02 18:01:08.742338 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:08.742322    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b\": container with ID starting with e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b not found: ID does not exist" containerID="e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"
Nov 02 18:01:08.742406 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.742344    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b"} err="failed to get container status \"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b\": rpc error: code = NotFound desc = could not find container \"e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b\": container with ID starting with e2011fc548e36fc44ce2d35ba733246cd9e16db48a860fd00d239022da69174b not found: ID does not exist"
Nov 02 18:01:08.763497 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763470    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763522    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763547    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763565    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763602    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763856 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763681    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:08.763856 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763720    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.763976 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763850    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:08.763976 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763912    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:08.763976 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.763967    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.764138 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764051    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.764138 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764103    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\") pod \"4579446b-2ff3-4f17-ae15-1310d427a921\" (UID: \"4579446b-2ff3-4f17-ae15-1310d427a921\") "
Nov 02 18:01:08.764268 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764234    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:08.764511 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764466    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:08.764725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764623    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.764725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764645    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4579446b-2ff3-4f17-ae15-1310d427a921-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.764725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764659    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.764725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764674    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.764725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.764688    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.766184 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.766149    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:08.766572 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.766531    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:01:08.766572 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.766534    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "kube-api-access-qfnb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:08.766728 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.766625    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy" pod "4579446b-2ff3-4f17-ae15-1310d427a921" (UID: "4579446b-2ff3-4f17-ae15-1310d427a921"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:08.865337 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.865309    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4579446b-2ff3-4f17-ae15-1310d427a921-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.865337 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.865335    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4579446b-2ff3-4f17-ae15-1310d427a921-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.865493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.865344    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.865493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.865354    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfnb6\" (UniqueName: \"kubernetes.io/projected/4579446b-2ff3-4f17-ae15-1310d427a921-kube-api-access-qfnb6\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:08.922923 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:08.922896    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 18:01:09.048490 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:09.048445    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 18:01:09.050146 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:09.050123    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-263a5ecf-openshift-default-55f7b95f77-7xlq7"]
Nov 02 18:01:10.616018 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:10.615988    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" path="/var/lib/kubelet/pods/4579446b-2ff3-4f17-ae15-1310d427a921/volumes"
Nov 02 18:01:14.306411 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:14.306376    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 18:01:14.316814 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:14.316781    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 18:01:15.835429 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:15.835396    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:01:19.307454 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:19.307384    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing" containerID="cri-o://6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089" gracePeriod=25
Nov 02 18:01:19.317068 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:19.317030    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing" containerID="cri-o://f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4" gracePeriod=25
Nov 02 18:01:23.943571 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:23.943530    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" containerID="cri-o://0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585" gracePeriod=45
Nov 02 18:01:24.199910 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.199833    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 18:01:24.337132 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337103    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337321 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337157    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337321 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337227    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337321 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337299    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337506 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337346    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\" (UniqueName: \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337506 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337382    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\") pod \"dacc428c-95c0-403d-8898-121bd5455071\" (UID: \"dacc428c-95c0-403d-8898-121bd5455071\") "
Nov 02 18:01:24.337625 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337511    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:24.337687 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337627    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:24.337754 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337730    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:24.337867 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337820    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.337867 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337865    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.338066 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.337879    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.339441 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.339415    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:01:24.339532 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.339449    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:24.339532 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.339487    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz" pod "dacc428c-95c0-403d-8898-121bd5455071" (UID: "dacc428c-95c0-403d-8898-121bd5455071"). InnerVolumeSpecName "kube-api-access-z74wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:24.439262 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.439228    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc428c-95c0-403d-8898-121bd5455071-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.439262 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.439254    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc428c-95c0-403d-8898-121bd5455071-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.439262 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.439265    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74wz\" (UniqueName: \"kubernetes.io/projected/dacc428c-95c0-403d-8898-121bd5455071-kube-api-access-z74wz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:24.832195 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.832162    5054 generic.go:356] "Generic (PLEG): container finished" podID="dacc428c-95c0-403d-8898-121bd5455071" containerID="0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585" exitCode=0
Nov 02 18:01:24.832509 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.832203    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"
Nov 02 18:01:24.832509 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.832287    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" event={"ID":"dacc428c-95c0-403d-8898-121bd5455071","Type":"ContainerDied","Data":"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"}
Nov 02 18:01:24.832509 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.832343    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" event={"ID":"dacc428c-95c0-403d-8898-121bd5455071","Type":"ContainerDied","Data":"acd012c4933d3ba33af882355a3a82bea917da52f26a95ec5d5107a8ef45a1d5"}
Nov 02 18:01:24.832509 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.832364    5054 scope.go:122] "RemoveContainer" containerID="0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"
Nov 02 18:01:24.842160 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.842142    5054 scope.go:122] "RemoveContainer" containerID="0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"
Nov 02 18:01:24.842459 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:24.842438    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585\": container with ID starting with 0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585 not found: ID does not exist" containerID="0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"
Nov 02 18:01:24.842554 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.842467    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585"} err="failed to get container status \"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585\": rpc error: code = NotFound desc = could not find container \"0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585\": container with ID starting with 0e71ae68f57562f9ba69801182619fc5d7ee037f0d4cfd7735b47b16d9bd8585 not found: ID does not exist"
Nov 02 18:01:24.852558 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.852531    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 18:01:24.860931 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:24.860899    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj"]
Nov 02 18:01:25.146475 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:25.146435    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb4ecb/premium-w2-bb4ecb-kserve-5c66c9d466-jsfwj" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:01:25.793329 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:25.793293    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:01:25.795124 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:25.795092    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:01:26.620089 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:26.620044    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dacc428c-95c0-403d-8898-121bd5455071" path="/var/lib/kubelet/pods/dacc428c-95c0-403d-8898-121bd5455071/volumes"
Nov 02 18:01:26.991129 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:26.991083    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:01:29.785499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:29.785463    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 18:01:29.785990 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:29.785746    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" podUID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" containerName="maas-api" containerID="cri-o://2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70" gracePeriod=30
Nov 02 18:01:30.112668 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.112636    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 18:01:30.231406 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.231376    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\" (UniqueName: \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\") pod \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") "
Nov 02 18:01:30.231602 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.231425    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\") pod \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") "
Nov 02 18:01:30.231602 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.231510    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\") pod \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") "
Nov 02 18:01:30.231724 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.231626    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\") pod \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\" (UID: \"20e56e55-3e4f-4e3c-a339-9cab919c11a5\") "
Nov 02 18:01:30.232135 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.231984    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca" pod "20e56e55-3e4f-4e3c-a339-9cab919c11a5" (UID: "20e56e55-3e4f-4e3c-a339-9cab919c11a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:30.232135 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.232085    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e56e55-3e4f-4e3c-a339-9cab919c11a5-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:30.234501 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.234471    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr" pod "20e56e55-3e4f-4e3c-a339-9cab919c11a5" (UID: "20e56e55-3e4f-4e3c-a339-9cab919c11a5"). InnerVolumeSpecName "kube-api-access-7j8wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:30.234657 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.234507    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls" pod "20e56e55-3e4f-4e3c-a339-9cab919c11a5" (UID: "20e56e55-3e4f-4e3c-a339-9cab919c11a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:01:30.235240 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.235219    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs" pod "20e56e55-3e4f-4e3c-a339-9cab919c11a5" (UID: "20e56e55-3e4f-4e3c-a339-9cab919c11a5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:01:30.333593 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.333508    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:30.333593 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.333538    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j8wr\" (UniqueName: \"kubernetes.io/projected/20e56e55-3e4f-4e3c-a339-9cab919c11a5-kube-api-access-7j8wr\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:30.333593 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.333549    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e56e55-3e4f-4e3c-a339-9cab919c11a5-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:30.912915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.899383    5054 generic.go:356] "Generic (PLEG): container finished" podID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" containerID="2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70" exitCode=0
Nov 02 18:01:30.912915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.899475    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" event={"ID":"20e56e55-3e4f-4e3c-a339-9cab919c11a5","Type":"ContainerDied","Data":"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"}
Nov 02 18:01:30.912915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.899523    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7" event={"ID":"20e56e55-3e4f-4e3c-a339-9cab919c11a5","Type":"ContainerDied","Data":"a6e81c8e5af37d84f6de7511fe9adbbd7a6dec2c59693518a433dfde9d7ddd78"}
Nov 02 18:01:30.912915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.899552    5054 scope.go:122] "RemoveContainer" containerID="2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"
Nov 02 18:01:30.912915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.899709    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"
Nov 02 18:01:30.961082 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.960999    5054 scope.go:122] "RemoveContainer" containerID="2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"
Nov 02 18:01:30.961449 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:30.961414    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70\": container with ID starting with 2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70 not found: ID does not exist" containerID="2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"
Nov 02 18:01:30.961583 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.961488    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70"} err="failed to get container status \"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70\": rpc error: code = NotFound desc = could not find container \"2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70\": container with ID starting with 2ab3158be46fe794e02ce6f0842751613267d4a0c935963efa07d90d5a747f70 not found: ID does not exist"
Nov 02 18:01:30.961583 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.961525    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 18:01:30.965982 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:30.965890    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb4ecb-748bc7fdcc-ctxn7"]
Nov 02 18:01:32.617227 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:32.617190    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" path="/var/lib/kubelet/pods/20e56e55-3e4f-4e3c-a339-9cab919c11a5/volumes"
Nov 02 18:01:33.269809 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:33.269769    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:01:35.793978 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:35.793937    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:01:35.795200 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:35.795158    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:01:37.339709 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.339623    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 18:01:37.340168 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.339833    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy" containerID="cri-o://323d045a85f2be3147eebea0fc193eb1ef614b11fb73983874bcd4f9eeb73654" gracePeriod=30
Nov 02 18:01:37.355764 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.355736    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 18:01:37.355995 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.355974    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy" containerID="cri-o://467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7" gracePeriod=30
Nov 02 18:01:37.360469 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.360446    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 18:01:37.360623 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:37.360605    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy" containerID="cri-o://39ede66a7d41f426e2e351b34e3477a7dd91c98a23e674bb84f3ee67424b1a84" gracePeriod=30
Nov 02 18:01:39.583520 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.583465    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 18:01:39.621135 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.621108    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 18:01:39.658618 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.658583    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\" (UniqueName: \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\") pod \"50898e3a-334e-4c6d-9507-676d39acd4ac\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") "
Nov 02 18:01:39.658791 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.658675    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\") pod \"50898e3a-334e-4c6d-9507-676d39acd4ac\" (UID: \"50898e3a-334e-4c6d-9507-676d39acd4ac\") "
Nov 02 18:01:39.659183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.659149    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume" pod "50898e3a-334e-4c6d-9507-676d39acd4ac" (UID: "50898e3a-334e-4c6d-9507-676d39acd4ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:39.660830 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.660802    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs" pod "50898e3a-334e-4c6d-9507-676d39acd4ac" (UID: "50898e3a-334e-4c6d-9507-676d39acd4ac"). InnerVolumeSpecName "kube-api-access-whsvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:39.760018 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.759988    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\" (UniqueName: \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\") pod \"905f9140-3a46-4cac-89af-b6aa42f0724a\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") "
Nov 02 18:01:39.760190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.760096    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\") pod \"905f9140-3a46-4cac-89af-b6aa42f0724a\" (UID: \"905f9140-3a46-4cac-89af-b6aa42f0724a\") "
Nov 02 18:01:39.760311 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.760300    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whsvs\" (UniqueName: \"kubernetes.io/projected/50898e3a-334e-4c6d-9507-676d39acd4ac-kube-api-access-whsvs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:39.760347 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.760313    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50898e3a-334e-4c6d-9507-676d39acd4ac-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:39.760431 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.760402    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume" pod "905f9140-3a46-4cac-89af-b6aa42f0724a" (UID: "905f9140-3a46-4cac-89af-b6aa42f0724a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:39.762175 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.762151    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx" pod "905f9140-3a46-4cac-89af-b6aa42f0724a" (UID: "905f9140-3a46-4cac-89af-b6aa42f0724a"). InnerVolumeSpecName "kube-api-access-2hjbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:39.861688 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.861610    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hjbx\" (UniqueName: \"kubernetes.io/projected/905f9140-3a46-4cac-89af-b6aa42f0724a-kube-api-access-2hjbx\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:39.861688 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.861640    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/905f9140-3a46-4cac-89af-b6aa42f0724a-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:39.965688 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.965654    5054 generic.go:356] "Generic (PLEG): container finished" podID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerID="6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089" exitCode=0
Nov 02 18:01:39.965884 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.965696    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"
Nov 02 18:01:39.965884 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.965736    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" event={"ID":"50898e3a-334e-4c6d-9507-676d39acd4ac","Type":"ContainerDied","Data":"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"}
Nov 02 18:01:39.965884 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.965789    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq" event={"ID":"50898e3a-334e-4c6d-9507-676d39acd4ac","Type":"ContainerDied","Data":"0bdc6fe3eea5703954f88cfd26838d1c031c74e63933e977e645cf21b016cd2a"}
Nov 02 18:01:39.965884 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.965813    5054 scope.go:122] "RemoveContainer" containerID="6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"
Nov 02 18:01:39.967310 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.967286    5054 generic.go:356] "Generic (PLEG): container finished" podID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerID="f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4" exitCode=0
Nov 02 18:01:39.967426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.967332    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"
Nov 02 18:01:39.967426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.967372    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" event={"ID":"905f9140-3a46-4cac-89af-b6aa42f0724a","Type":"ContainerDied","Data":"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"}
Nov 02 18:01:39.967511 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.967422    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f" event={"ID":"905f9140-3a46-4cac-89af-b6aa42f0724a","Type":"ContainerDied","Data":"5ac88b1c48b7f809991900e0f051495caae005ad8aae0b8bf70860833b1e3588"}
Nov 02 18:01:39.977598 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.977574    5054 scope.go:122] "RemoveContainer" containerID="6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"
Nov 02 18:01:39.977941 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:39.977921    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089\": container with ID starting with 6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089 not found: ID does not exist" containerID="6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"
Nov 02 18:01:39.978027 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.977948    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089"} err="failed to get container status \"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089\": rpc error: code = NotFound desc = could not find container \"6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089\": container with ID starting with 6cc3406d91d3ded73a4c588a113647f78bd399a51c8ac63d34dbc1979493f089 not found: ID does not exist"
Nov 02 18:01:39.978027 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.977964    5054 scope.go:122] "RemoveContainer" containerID="f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"
Nov 02 18:01:39.987315 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.987297    5054 scope.go:122] "RemoveContainer" containerID="f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"
Nov 02 18:01:39.987570 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:39.987550    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4\": container with ID starting with f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4 not found: ID does not exist" containerID="f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"
Nov 02 18:01:39.987619 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:39.987577    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4"} err="failed to get container status \"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4\": rpc error: code = NotFound desc = could not find container \"f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4\": container with ID starting with f1dc07939996269020380bf52a99a1f67ad1f33c198d2b8431c424678d2628c4 not found: ID does not exist"
Nov 02 18:01:40.011426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.011398    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 18:01:40.015574 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.015548    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb4ecb-84c4bb876c-cwg6f"]
Nov 02 18:01:40.029973 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.029952    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 18:01:40.033948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.033927    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb4ecb-64f99f6b6c-mqbwq"]
Nov 02 18:01:40.616326 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.616249    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" path="/var/lib/kubelet/pods/50898e3a-334e-4c6d-9507-676d39acd4ac/volumes"
Nov 02 18:01:40.616694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:40.616651    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" path="/var/lib/kubelet/pods/905f9140-3a46-4cac-89af-b6aa42f0724a/volumes"
Nov 02 18:01:43.133913 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.133731    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 18:01:43.283862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.281970    5054 generic.go:356] "Generic (PLEG): container finished" podID="4357e330-23a7-4f00-94fe-36852eaabef5" containerID="39ede66a7d41f426e2e351b34e3477a7dd91c98a23e674bb84f3ee67424b1a84" exitCode=0
Nov 02 18:01:43.283862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.282106    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" event={"ID":"4357e330-23a7-4f00-94fe-36852eaabef5","Type":"ContainerDied","Data":"39ede66a7d41f426e2e351b34e3477a7dd91c98a23e674bb84f3ee67424b1a84"}
Nov 02 18:01:43.368914 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.343142    5054 generic.go:356] "Generic (PLEG): container finished" podID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerID="467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7" exitCode=0
Nov 02 18:01:43.368914 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.343303    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" event={"ID":"c0f62f1e-d291-4a97-bdde-937c695623a6","Type":"ContainerDied","Data":"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"}
Nov 02 18:01:43.368914 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.343362    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x" event={"ID":"c0f62f1e-d291-4a97-bdde-937c695623a6","Type":"ContainerDied","Data":"3bacf20b6d94a334d01413ac4ffe92e4783c7ca4deb6173cdfdf12b8377e86d0"}
Nov 02 18:01:43.368914 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.343405    5054 scope.go:122] "RemoveContainer" containerID="467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"
Nov 02 18:01:43.368914 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.343604    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393292    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393340    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393385    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393503    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393534    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393568    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393606    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393656    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.405237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.393758    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\") pod \"c0f62f1e-d291-4a97-bdde-937c695623a6\" (UID: \"c0f62f1e-d291-4a97-bdde-937c695623a6\") "
Nov 02 18:01:43.430861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.421874    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.430861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.422325    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.430861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.422623    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:43.430861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.422873    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.430861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.429930    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.500047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.499696    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.500047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.499735    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.500047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.499752    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.500047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.499767    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f62f1e-d291-4a97-bdde-937c695623a6-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.500047 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.499781    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.551953 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.551667    5054 generic.go:356] "Generic (PLEG): container finished" podID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerID="323d045a85f2be3147eebea0fc193eb1ef614b11fb73983874bcd4f9eeb73654" exitCode=0
Nov 02 18:01:43.551953 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.551789    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerDied","Data":"323d045a85f2be3147eebea0fc193eb1ef614b11fb73983874bcd4f9eeb73654"}
Nov 02 18:01:43.572006 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.571946    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "kube-api-access-s49qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:43.659927 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.610973    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:01:43.659927 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.611969    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.659927 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.611998    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s49qg\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-kube-api-access-s49qg\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.740864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.740353    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.740864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.740485    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token" pod "c0f62f1e-d291-4a97-bdde-937c695623a6" (UID: "c0f62f1e-d291-4a97-bdde-937c695623a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:43.740864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.740701    5054 scope.go:122] "RemoveContainer" containerID="467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"
Nov 02 18:01:43.741862 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:43.741687    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7\": container with ID starting with 467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7 not found: ID does not exist" containerID="467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"
Nov 02 18:01:43.741862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.741743    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7"} err="failed to get container status \"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7\": rpc error: code = NotFound desc = could not find container \"467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7\": container with ID starting with 467a6c7cbf8d62b182d7dc35e30d90af7498234037ef7ddac7c4a2cba0f3b4f7 not found: ID does not exist"
Nov 02 18:01:43.741862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.741768    5054 scope.go:122] "RemoveContainer" containerID="1071224f66c9dea7ed71c1e33148d8179a3656b5781bac1113d997abeb6f1f87"
Nov 02 18:01:43.746134 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.744770    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 18:01:43.763866 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.761392    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 18:01:43.845864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.838007    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.845864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.838047    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f62f1e-d291-4a97-bdde-937c695623a6-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944761    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944825    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944878    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944905    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944951    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.944988    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945024    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945061    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945101    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945136    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945219    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945262    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945300    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945331    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\") pod \"4357e330-23a7-4f00-94fe-36852eaabef5\" (UID: \"4357e330-23a7-4f00-94fe-36852eaabef5\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945376    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945408    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945444    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.954094 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.945510    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\") pod \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\" (UID: \"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c\") "
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.956453    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.956824    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.957532    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.957719    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.957913    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.958087    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.958260    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.958434    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.961338    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.963713    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.964057    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.966315    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:43.989928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:43.966517    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072319    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072378    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072397    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072412    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072448    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072465    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072479    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072493    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072531    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4357e330-23a7-4f00-94fe-36852eaabef5-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072547    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4357e330-23a7-4f00-94fe-36852eaabef5-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072561    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072595    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.089862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.072612    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.121113 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.121036    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "kube-api-access-tdz7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:44.165863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.165063    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:44.165863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.165204    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo" pod "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" (UID: "13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:01:44.165863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.165300    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:01:44.165863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.165398    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw" pod "4357e330-23a7-4f00-94fe-36852eaabef5" (UID: "4357e330-23a7-4f00-94fe-36852eaabef5"). InnerVolumeSpecName "kube-api-access-s7tgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:01:44.224919 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.202631    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.224919 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.202671    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdz7w\" (UniqueName: \"kubernetes.io/projected/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c-kube-api-access-tdz7w\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.224919 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.202687    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.224919 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.202704    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7tgw\" (UniqueName: \"kubernetes.io/projected/4357e330-23a7-4f00-94fe-36852eaabef5-kube-api-access-s7tgw\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.224919 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.202718    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4357e330-23a7-4f00-94fe-36852eaabef5-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:01:44.341013 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.340902    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 18:01:44.341249 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.341226    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-cvm2x"]
Nov 02 18:01:44.580918 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.580329    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc" event={"ID":"13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c","Type":"ContainerDied","Data":"df340528fc143c897af387e2e5f7a552366d62a7dba66bffe01901d1116f0f34"}
Nov 02 18:01:44.580918 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.580404    5054 scope.go:122] "RemoveContainer" containerID="323d045a85f2be3147eebea0fc193eb1ef614b11fb73983874bcd4f9eeb73654"
Nov 02 18:01:44.580918 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.580519    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"
Nov 02 18:01:44.625988 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.624635    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"
Nov 02 18:01:44.652610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.652133    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:01:44.652610 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.652194    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:01:44.694297 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.694265    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" path="/var/lib/kubelet/pods/c0f62f1e-d291-4a97-bdde-937c695623a6/volumes"
Nov 02 18:01:44.695362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.695335    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2" event={"ID":"4357e330-23a7-4f00-94fe-36852eaabef5","Type":"ContainerDied","Data":"8def584464073f6abc4e009d448fd2e64f819130ab4faa888b0cd5fb61ea69dc"}
Nov 02 18:01:44.732920 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.726427    5054 scope.go:122] "RemoveContainer" containerID="39ede66a7d41f426e2e351b34e3477a7dd91c98a23e674bb84f3ee67424b1a84"
Nov 02 18:01:44.815038 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.806891    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 18:01:44.815038 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.807738    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-hjwdc"]
Nov 02 18:01:44.826906 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.824398    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 18:01:44.850093 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:44.850022    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb4ecb-openshift-default-f98db5885-rbnz2"]
Nov 02 18:01:45.839174 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:01:45.839137    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:01:46.618206 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:46.618167    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" path="/var/lib/kubelet/pods/13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c/volumes"
Nov 02 18:01:46.618731 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:01:46.618710    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" path="/var/lib/kubelet/pods/4357e330-23a7-4f00-94fe-36852eaabef5/volumes"
Nov 02 18:02:15.837254 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:02:15.837215    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:02:45.834656 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:02:45.834615    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:02:46.038671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:46.038640    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"]
Nov 02 18:02:46.043707 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:46.043674    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a3fa5109-754b4"]
Nov 02 18:02:46.617132 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:46.617100    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2431bef3-ad2c-4304-83ed-41cf2b404fa7" path="/var/lib/kubelet/pods/2431bef3-ad2c-4304-83ed-41cf2b404fa7/volumes"
Nov 02 18:02:49.693704 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:49.693674    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:02:52.353863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:52.352953    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:02:52.353863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:02:52.353039    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:03:07.897143 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:07.897052    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:03:11.392450 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:11.392415    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:03:14.589862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:14.587003    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:03:14.589862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:14.587137    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:03:15.835223 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:03:15.835183    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:03:28.875320 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:28.875280    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:03:41.753103 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:41.753066    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:03:44.633963 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:44.633922    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:03:44.639968 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:44.639916    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:03:45.836908 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:03:45.836866    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:03:57.575990 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:03:57.575952    5054 scope.go:122] "RemoveContainer" containerID="78cde3174c3076a0c89e3674287653b9c730e86de341f4e958963dc6f70c0519"
Nov 02 18:04:06.057187 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:06.057146    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:04:15.836275 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:04:15.836231    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:04:16.567523 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:16.567482    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:04:28.194958 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:28.194923    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:04:45.835796 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:04:45.835706    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:04:47.377778 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:47.377731    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:04:51.772864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:51.772267    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:04:52.353057 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:52.353017    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2h5cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:04:52.353355 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:52.353320    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2h5cq" podUID="cb081cae-ffe6-4842-82fc-acd8683d6e87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:04:56.880717 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:56.880687    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:04:56.883604 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:56.883578    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:04:56.888511 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:56.888494    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:04:56.891278 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:04:56.891263    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:05:05.763424 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:05.763388    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:10.813135 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:10.813091    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:11.254863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:11.254654    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:05:11.254863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:11.254722    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:05:11.268866 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:11.268376    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:05:11.268866 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:11.268432    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:05:15.835951 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:05:15.835913    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:05:24.577750 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:24.577713    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:27.195022 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.194982    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 18:05:27.195800 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.195752    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerName="discovery" containerID="cri-o://ad4c252b62290fc88d29679159b696f7876ea53af28f8f33fcff854b76cd9910" gracePeriod=30
Nov 02 18:05:27.497195 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.497107    5054 generic.go:356] "Generic (PLEG): container finished" podID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerID="ad4c252b62290fc88d29679159b696f7876ea53af28f8f33fcff854b76cd9910" exitCode=0
Nov 02 18:05:27.497582 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.497553    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" event={"ID":"c69179cf-29b5-4af9-b8e0-c272d8f32e0e","Type":"ContainerDied","Data":"ad4c252b62290fc88d29679159b696f7876ea53af28f8f33fcff854b76cd9910"}
Nov 02 18:05:27.534241 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.534205    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 18:05:27.583546 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.583506    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.584400 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.584373    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.585007 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.584987    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.585527 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.585508    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.586169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.586149    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.586711 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.586691    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.587434 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.587413    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\") pod \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\" (UID: \"c69179cf-29b5-4af9-b8e0-c272d8f32e0e\") "
Nov 02 18:05:27.588442 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.584298    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:05:27.618801 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.618717    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:05:27.621951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.621044    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "kube-api-access-dfqcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:05:27.623002 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.622968    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:05:27.623127 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.623076    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:05:27.623492 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.623464    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:05:27.623885 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.623857    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs" pod "c69179cf-29b5-4af9-b8e0-c272d8f32e0e" (UID: "c69179cf-29b5-4af9-b8e0-c272d8f32e0e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688854    5054 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-kubeconfig\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688903    5054 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-ca-configmap\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688922    5054 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-local-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688936    5054 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-cacerts\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688952    5054 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-csr-dns-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688967    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfqcz\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-kube-api-access-dfqcz\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:27.689044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:27.688981    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69179cf-29b5-4af9-b8e0-c272d8f32e0e-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:28.008863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.003288    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:28.522704 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.522662    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5" event={"ID":"c69179cf-29b5-4af9-b8e0-c272d8f32e0e","Type":"ContainerDied","Data":"70b823abd651755844e121a77a3bea178c0918ca72236a97f9d0be1eb5bdef04"}
Nov 02 18:05:28.523391 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.523356    5054 scope.go:122] "RemoveContainer" containerID="ad4c252b62290fc88d29679159b696f7876ea53af28f8f33fcff854b76cd9910"
Nov 02 18:05:28.523702 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.523682    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"
Nov 02 18:05:28.724864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.724087    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 18:05:28.759868 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:28.757461    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qbbh5"]
Nov 02 18:05:29.687072 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:29.687030    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9qwsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:05:29.704040 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:29.703994    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9qwsm" podUID="ed01a4fb-b9a6-412a-9405-e5642d0ce442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:05:30.616468 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:30.616425    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" path="/var/lib/kubelet/pods/c69179cf-29b5-4af9-b8e0-c272d8f32e0e/volumes"
Nov 02 18:05:31.464303 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.464255    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"]
Nov 02 18:05:31.465068 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465044    5054 cpu_manager.go:414] "containerMap: removing container" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy"
Nov 02 18:05:31.465118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465074    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy"
Nov 02 18:05:31.465118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465099    5054 cpu_manager.go:414] "containerMap: removing container" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerName="discovery"
Nov 02 18:05:31.465118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465107    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerName="discovery"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465121    5054 cpu_manager.go:414] "containerMap: removing container" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465130    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465140    5054 cpu_manager.go:414] "containerMap: removing container" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465149    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465164    5054 cpu_manager.go:414] "containerMap: removing container" podUID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" containerName="payload-processing"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465173    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" containerName="payload-processing"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465186    5054 cpu_manager.go:414] "containerMap: removing container" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465194    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465206    5054 cpu_manager.go:414] "containerMap: removing container" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy"
Nov 02 18:05:31.465216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465214    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465226    5054 cpu_manager.go:414] "containerMap: removing container" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465235    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465248    5054 cpu_manager.go:414] "containerMap: removing container" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465255    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465268    5054 cpu_manager.go:414] "containerMap: removing container" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465276    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465288    5054 cpu_manager.go:414] "containerMap: removing container" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465296    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465309    5054 cpu_manager.go:414] "containerMap: removing container" podUID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" containerName="maas-api"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465317    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" containerName="maas-api"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465334    5054 cpu_manager.go:414] "containerMap: removing container" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465345    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465356    5054 cpu_manager.go:414] "containerMap: removing container" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465365    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465391    5054 cpu_manager.go:414] "containerMap: removing container" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465400    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465409    5054 cpu_manager.go:414] "containerMap: removing container" podUID="42fcae34-3692-4003-b84c-2e5e6ceb3511" containerName="maas-api"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465417    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42fcae34-3692-4003-b84c-2e5e6ceb3511" containerName="maas-api"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465433    5054 cpu_manager.go:414] "containerMap: removing container" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465440    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465455    5054 cpu_manager.go:414] "containerMap: removing container" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465462    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465478    5054 cpu_manager.go:414] "containerMap: removing container" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.465502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465486    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465613    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="50898e3a-334e-4c6d-9507-676d39acd4ac" containerName="payload-processing"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465629    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd10872f-54d6-46db-954f-ae6162ac8247" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465638    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="565063da-8069-4447-acf9-a39779f5b1eb" containerName="payload-pre-processing"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465647    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="20e56e55-3e4f-4e3c-a339-9cab919c11a5" containerName="maas-api"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465656    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465667    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465675    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="da3621a8-307a-44ec-ab7e-c7d6459c5e9d" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465687    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465694    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="42fcae34-3692-4003-b84c-2e5e6ceb3511" containerName="maas-api"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465703    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465715    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="dacc428c-95c0-403d-8898-121bd5455071" containerName="main"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465728    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="13b9eacd-5bc8-4e2b-b1f2-0c11b4e3ef1c" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465739    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="5847ab4b-c016-4075-a990-994effeda769" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465749    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="c69179cf-29b5-4af9-b8e0-c272d8f32e0e" containerName="discovery"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465757    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="4357e330-23a7-4f00-94fe-36852eaabef5" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465768    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="11572de4-2eb4-4ca3-99f0-bbfb3927d88f" containerName="payload-processing"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465777    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0f62f1e-d291-4a97-bdde-937c695623a6" containerName="istio-proxy"
Nov 02 18:05:31.466212 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.465786    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="905f9140-3a46-4cac-89af-b6aa42f0724a" containerName="payload-pre-processing"
Nov 02 18:05:31.470933 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.470910    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.476804 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.476768    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:05:31.477115 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.477096    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:05:31.478443 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.478406    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:05:31.479988 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.479948    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:05:31.482182 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.482161    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"]
Nov 02 18:05:31.609410 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.609368    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.609587 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.609458    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szf9c\" (UniqueName: \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.609587 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.609495    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.711139 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.711094    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.711359 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.711272    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szf9c\" (UniqueName: \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.711359 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.711340    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.711957 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.711929    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.713814 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.713789    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.723171 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.723119    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szf9c\" (UniqueName: \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\") pod \"maas-api-revoke-sub-0b7e8edb-mlwhz\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:31.794370 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:31.794332    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:32.081041 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:32.081013    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"]
Nov 02 18:05:32.082434 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:05:32.082404    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b2c1c2_5d69_4df1_85e7_e654653797b2.slice/crio-56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea WatchSource:0}: Error finding container 56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea: Status 404 returned error can't find the container with id 56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea
Nov 02 18:05:32.773791 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:32.773751    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz" event={"ID":"16b2c1c2-5d69-4df1-85e7-e654653797b2","Type":"ContainerStarted","Data":"325425621d96eb0cf68e6f89d303e96b34ae78c1f81c70ef5ead6d063d327f83"}
Nov 02 18:05:32.774213 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:32.773819    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz" event={"ID":"16b2c1c2-5d69-4df1-85e7-e654653797b2","Type":"ContainerStarted","Data":"56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea"}
Nov 02 18:05:32.795988 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:32.795938    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz" podStartSLOduration=1.7959237510000001 podStartE2EDuration="1.795923751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:05:32.793224111 +0000 UTC m=+1536.301986179" watchObservedRunningTime="2026-11-02 18:05:32.795923751 +0000 UTC m=+1536.304685815"
Nov 02 18:05:33.780568 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:33.780533    5054 generic.go:356] "Generic (PLEG): container finished" podID="16b2c1c2-5d69-4df1-85e7-e654653797b2" containerID="325425621d96eb0cf68e6f89d303e96b34ae78c1f81c70ef5ead6d063d327f83" exitCode=0
Nov 02 18:05:33.781055 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:33.780620    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz" event={"ID":"16b2c1c2-5d69-4df1-85e7-e654653797b2","Type":"ContainerDied","Data":"325425621d96eb0cf68e6f89d303e96b34ae78c1f81c70ef5ead6d063d327f83"}
Nov 02 18:05:34.923571 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:34.923547    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:35.046017 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.045934    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\" (UniqueName: \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\") pod \"16b2c1c2-5d69-4df1-85e7-e654653797b2\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") "
Nov 02 18:05:35.046017 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.045976    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\") pod \"16b2c1c2-5d69-4df1-85e7-e654653797b2\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") "
Nov 02 18:05:35.046202 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.046043    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\") pod \"16b2c1c2-5d69-4df1-85e7-e654653797b2\" (UID: \"16b2c1c2-5d69-4df1-85e7-e654653797b2\") "
Nov 02 18:05:35.046383 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.046346    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca" pod "16b2c1c2-5d69-4df1-85e7-e654653797b2" (UID: "16b2c1c2-5d69-4df1-85e7-e654653797b2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:05:35.048205 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.048177    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca" pod "16b2c1c2-5d69-4df1-85e7-e654653797b2" (UID: "16b2c1c2-5d69-4df1-85e7-e654653797b2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:05:35.048272 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.048232    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c" pod "16b2c1c2-5d69-4df1-85e7-e654653797b2" (UID: "16b2c1c2-5d69-4df1-85e7-e654653797b2"). InnerVolumeSpecName "kube-api-access-szf9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:05:35.146972 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.146933    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szf9c\" (UniqueName: \"kubernetes.io/projected/16b2c1c2-5d69-4df1-85e7-e654653797b2-kube-api-access-szf9c\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:35.146972 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.146966    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:35.146972 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.146976    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/16b2c1c2-5d69-4df1-85e7-e654653797b2-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:35.792924 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.792887    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz" event={"ID":"16b2c1c2-5d69-4df1-85e7-e654653797b2","Type":"ContainerDied","Data":"56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea"}
Nov 02 18:05:35.792924 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.792912    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"
Nov 02 18:05:35.793186 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:35.792937    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56f46402119e673d14c75838975aad92c5fd34965d0df7c6e4ee2b60c80beeea"
Nov 02 18:05:42.103079 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103043    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"]
Nov 02 18:05:42.103506 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103493    5054 cpu_manager.go:414] "containerMap: removing container" podUID="16b2c1c2-5d69-4df1-85e7-e654653797b2" containerName="revoke-keys"
Nov 02 18:05:42.103566 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103506    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b2c1c2-5d69-4df1-85e7-e654653797b2" containerName="revoke-keys"
Nov 02 18:05:42.103566 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103523    5054 cpu_manager.go:414] "containerMap: removing container" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:42.103566 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103529    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:42.103661 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103592    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a117e54-fdd2-4ada-84a8-b9654dd451cf" containerName="cleanup"
Nov 02 18:05:42.103661 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103602    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="4579446b-2ff3-4f17-ae15-1310d427a921" containerName="istio-proxy"
Nov 02 18:05:42.103661 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.103611    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b2c1c2-5d69-4df1-85e7-e654653797b2" containerName="revoke-keys"
Nov 02 18:05:42.106915 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.106890    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.116418 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.116389    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:05:42.119273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.119249    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:05:42.119415 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.119356    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:05:42.119415 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.119383    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:05:42.120895 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.120867    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"]
Nov 02 18:05:42.213260 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.213229    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.213457 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.213373    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf6wv\" (UniqueName: \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.213457 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.213429    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.318652 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.318610    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf6wv\" (UniqueName: \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.318985 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.318955    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.319130 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.319049    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.322304 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.322279    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.327471 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.327300    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.330550 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.330529    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf6wv\" (UniqueName: \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\") pod \"maas-api-revoke-sub-3d4156f1-hmdw9\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.426053 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.426017    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:42.459761 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.459728    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:42.714027 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.713994    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"]
Nov 02 18:05:42.715708 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:05:42.715673    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50aca9da_38ba_46d3_9cff_98c66c334a7f.slice/crio-f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48 WatchSource:0}: Error finding container f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48: Status 404 returned error can't find the container with id f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48
Nov 02 18:05:42.832282 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:42.832246    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9" event={"ID":"50aca9da-38ba-46d3-9cff-98c66c334a7f","Type":"ContainerStarted","Data":"f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48"}
Nov 02 18:05:43.840013 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:43.839922    5054 generic.go:356] "Generic (PLEG): container finished" podID="50aca9da-38ba-46d3-9cff-98c66c334a7f" containerID="5a908a5ad5aa9c154d65973e4e21349d552e18e44ea6d16b14bd8253a1636b51" exitCode=0
Nov 02 18:05:43.840369 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:43.840015    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9" event={"ID":"50aca9da-38ba-46d3-9cff-98c66c334a7f","Type":"ContainerDied","Data":"5a908a5ad5aa9c154d65973e4e21349d552e18e44ea6d16b14bd8253a1636b51"}
Nov 02 18:05:44.993354 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:44.993330    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:45.047683 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.047648    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\") pod \"50aca9da-38ba-46d3-9cff-98c66c334a7f\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") "
Nov 02 18:05:45.047878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.047720    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\" (UniqueName: \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\") pod \"50aca9da-38ba-46d3-9cff-98c66c334a7f\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") "
Nov 02 18:05:45.047878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.047797    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\") pod \"50aca9da-38ba-46d3-9cff-98c66c334a7f\" (UID: \"50aca9da-38ba-46d3-9cff-98c66c334a7f\") "
Nov 02 18:05:45.048157 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.048127    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca" pod "50aca9da-38ba-46d3-9cff-98c66c334a7f" (UID: "50aca9da-38ba-46d3-9cff-98c66c334a7f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:05:45.048315 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.048288    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:45.050035 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.050007    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca" pod "50aca9da-38ba-46d3-9cff-98c66c334a7f" (UID: "50aca9da-38ba-46d3-9cff-98c66c334a7f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:05:45.050035 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.050023    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv" pod "50aca9da-38ba-46d3-9cff-98c66c334a7f" (UID: "50aca9da-38ba-46d3-9cff-98c66c334a7f"). InnerVolumeSpecName "kube-api-access-hf6wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:05:45.149273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.149193    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/50aca9da-38ba-46d3-9cff-98c66c334a7f-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:45.149273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.149224    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf6wv\" (UniqueName: \"kubernetes.io/projected/50aca9da-38ba-46d3-9cff-98c66c334a7f-kube-api-access-hf6wv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:05:45.835911 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:05:45.835814    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:05:45.853267 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.853242    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"
Nov 02 18:05:45.853397 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.853248    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9" event={"ID":"50aca9da-38ba-46d3-9cff-98c66c334a7f","Type":"ContainerDied","Data":"f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48"}
Nov 02 18:05:45.853397 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:45.853361    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f177797e02546d0080f1bf3ae6d38701097d18c0d481ad6f385ed9d136279e48"
Nov 02 18:05:53.057505 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:53.057469    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:05:56.261864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:56.259960    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:05:56.261864 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:56.260059    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:05:58.517759 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:05:58.517701    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:03.224491 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.224450    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"]
Nov 02 18:06:03.230422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.230391    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hmdw9"]
Nov 02 18:06:03.248794 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.248763    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"]
Nov 02 18:06:03.249231 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.249216    5054 cpu_manager.go:414] "containerMap: removing container" podUID="50aca9da-38ba-46d3-9cff-98c66c334a7f" containerName="revoke-keys"
Nov 02 18:06:03.249294 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.249231    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50aca9da-38ba-46d3-9cff-98c66c334a7f" containerName="revoke-keys"
Nov 02 18:06:03.249723 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.249699    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="50aca9da-38ba-46d3-9cff-98c66c334a7f" containerName="revoke-keys"
Nov 02 18:06:03.255804 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.255782    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.260553 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.260526    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:06:03.260796 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.260767    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:06:03.263900 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.263879    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"]
Nov 02 18:06:03.264578 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.264548    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.264682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.264611    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg9x8\" (UniqueName: \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.264682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.264648    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.267128 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.267108    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:06:03.267239 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.267156    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:06:03.365611 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.365574    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.365784 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.365620    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg9x8\" (UniqueName: \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.365784 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.365645    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.366334 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.366313    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.368002 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.367974    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.373892 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.373864    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg9x8\" (UniqueName: \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\") pod \"maas-api-revoke-sub-3d4156f1-tz22x\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.578472 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.578388    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:03.856389 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:03.856362    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"]
Nov 02 18:06:03.857884 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:06:03.857828    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925ce8b5_711d_4f57_bde4_75df84bbe190.slice/crio-c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105 WatchSource:0}: Error finding container c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105: Status 404 returned error can't find the container with id c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105
Nov 02 18:06:04.044663 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:04.044631    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x" event={"ID":"925ce8b5-711d-4f57-bde4-75df84bbe190","Type":"ContainerStarted","Data":"c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105"}
Nov 02 18:06:04.616246 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:04.616172    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50aca9da-38ba-46d3-9cff-98c66c334a7f" path="/var/lib/kubelet/pods/50aca9da-38ba-46d3-9cff-98c66c334a7f/volumes"
Nov 02 18:06:05.052571 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:05.052540    5054 generic.go:356] "Generic (PLEG): container finished" podID="925ce8b5-711d-4f57-bde4-75df84bbe190" containerID="5e46b7dad131730234756a9918aea03238031ce85d34e1a9cbadc70fff416401" exitCode=0
Nov 02 18:06:05.052746 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:05.052613    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x" event={"ID":"925ce8b5-711d-4f57-bde4-75df84bbe190","Type":"ContainerDied","Data":"5e46b7dad131730234756a9918aea03238031ce85d34e1a9cbadc70fff416401"}
Nov 02 18:06:06.201779 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.201756    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:06.288240 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.288200    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\") pod \"925ce8b5-711d-4f57-bde4-75df84bbe190\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") "
Nov 02 18:06:06.288437 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.288251    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\") pod \"925ce8b5-711d-4f57-bde4-75df84bbe190\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") "
Nov 02 18:06:06.288437 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.288345    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\" (UniqueName: \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\") pod \"925ce8b5-711d-4f57-bde4-75df84bbe190\" (UID: \"925ce8b5-711d-4f57-bde4-75df84bbe190\") "
Nov 02 18:06:06.288581 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.288551    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca" pod "925ce8b5-711d-4f57-bde4-75df84bbe190" (UID: "925ce8b5-711d-4f57-bde4-75df84bbe190"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:06:06.288668 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.288651    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:06.290449 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.290422    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca" pod "925ce8b5-711d-4f57-bde4-75df84bbe190" (UID: "925ce8b5-711d-4f57-bde4-75df84bbe190"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:06:06.290449 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.290439    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8" pod "925ce8b5-711d-4f57-bde4-75df84bbe190" (UID: "925ce8b5-711d-4f57-bde4-75df84bbe190"). InnerVolumeSpecName "kube-api-access-vg9x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:06:06.389977 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.389883    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg9x8\" (UniqueName: \"kubernetes.io/projected/925ce8b5-711d-4f57-bde4-75df84bbe190-kube-api-access-vg9x8\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:06.389977 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:06.389915    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/925ce8b5-711d-4f57-bde4-75df84bbe190-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:07.064412 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:07.064377    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x" event={"ID":"925ce8b5-711d-4f57-bde4-75df84bbe190","Type":"ContainerDied","Data":"c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105"}
Nov 02 18:06:07.064591 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:07.064417    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"
Nov 02 18:06:07.064591 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:07.064425    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c988c7794bb6d8b06bd9f0a90adc3fa1190a83b50976511fda7185a2415a5105"
Nov 02 18:06:14.731544 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:14.731498    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:15.836305 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:06:15.836258    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:06:18.549512 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:18.549471    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:24.252014 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:24.251971    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:31.621282 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.621248    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"]
Nov 02 18:06:31.621796 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.621655    5054 cpu_manager.go:414] "containerMap: removing container" podUID="925ce8b5-711d-4f57-bde4-75df84bbe190" containerName="revoke-keys"
Nov 02 18:06:31.621796 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.621667    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="925ce8b5-711d-4f57-bde4-75df84bbe190" containerName="revoke-keys"
Nov 02 18:06:31.621796 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.621770    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="925ce8b5-711d-4f57-bde4-75df84bbe190" containerName="revoke-keys"
Nov 02 18:06:31.625117 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.625100    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.632545 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.632519    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:06:31.632768 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.632752    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:06:31.632948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.632676    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:06:31.632948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.632561    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:06:31.635058 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.635037    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"]
Nov 02 18:06:31.752376 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.752341    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmcvv\" (UniqueName: \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.752534 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.752475    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.752534 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.752521    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.853407 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.853370    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.853577 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.853425    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.853577 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.853477    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmcvv\" (UniqueName: \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.854160 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.854129    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.855781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.855755    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.862126 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.862107    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmcvv\" (UniqueName: \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\") pod \"maas-api-revoke-sub-e2fc9c5b-9bbsd\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:31.940842 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:31.940815    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:32.216804 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:32.216772    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"]
Nov 02 18:06:32.218614 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:06:32.218590    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b24b30_f52b_40dc_be87_00de678e3f6e.slice/crio-468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7 WatchSource:0}: Error finding container 468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7: Status 404 returned error can't find the container with id 468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7
Nov 02 18:06:32.275411 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:32.275382    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd" event={"ID":"33b24b30-f52b-40dc-be87-00de678e3f6e","Type":"ContainerStarted","Data":"468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7"}
Nov 02 18:06:33.282902 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:33.282793    5054 generic.go:356] "Generic (PLEG): container finished" podID="33b24b30-f52b-40dc-be87-00de678e3f6e" containerID="231ded58da83fc5e4c6f10db8ae9f1bbbea14f098a53506e8aab83722d26ffd3" exitCode=0
Nov 02 18:06:33.282902 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:33.282881    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd" event={"ID":"33b24b30-f52b-40dc-be87-00de678e3f6e","Type":"ContainerDied","Data":"231ded58da83fc5e4c6f10db8ae9f1bbbea14f098a53506e8aab83722d26ffd3"}
Nov 02 18:06:34.416351 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.416328    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:34.480182 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.480151    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\" (UniqueName: \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\") pod \"33b24b30-f52b-40dc-be87-00de678e3f6e\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") "
Nov 02 18:06:34.480340 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.480209    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\") pod \"33b24b30-f52b-40dc-be87-00de678e3f6e\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") "
Nov 02 18:06:34.480340 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.480287    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\") pod \"33b24b30-f52b-40dc-be87-00de678e3f6e\" (UID: \"33b24b30-f52b-40dc-be87-00de678e3f6e\") "
Nov 02 18:06:34.480697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.480660    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca" pod "33b24b30-f52b-40dc-be87-00de678e3f6e" (UID: "33b24b30-f52b-40dc-be87-00de678e3f6e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:06:34.482379 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.482353    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca" pod "33b24b30-f52b-40dc-be87-00de678e3f6e" (UID: "33b24b30-f52b-40dc-be87-00de678e3f6e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:06:34.482493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.482453    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv" pod "33b24b30-f52b-40dc-be87-00de678e3f6e" (UID: "33b24b30-f52b-40dc-be87-00de678e3f6e"). InnerVolumeSpecName "kube-api-access-pmcvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:06:34.582183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.582107    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmcvv\" (UniqueName: \"kubernetes.io/projected/33b24b30-f52b-40dc-be87-00de678e3f6e-kube-api-access-pmcvv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:34.582183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.582138    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:34.582183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:34.582151    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33b24b30-f52b-40dc-be87-00de678e3f6e-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:35.294388 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:35.294342    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd" event={"ID":"33b24b30-f52b-40dc-be87-00de678e3f6e","Type":"ContainerDied","Data":"468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7"}
Nov 02 18:06:35.294388 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:35.294372    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"
Nov 02 18:06:35.294601 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:35.294434    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="468a2433b4ed4d1eea1b8ba3353730e2c0bab934c6b41286d5986e3f4e19dca7"
Nov 02 18:06:41.825479 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.825443    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"]
Nov 02 18:06:41.826119 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.826101    5054 cpu_manager.go:414] "containerMap: removing container" podUID="33b24b30-f52b-40dc-be87-00de678e3f6e" containerName="revoke-keys"
Nov 02 18:06:41.826172 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.826122    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33b24b30-f52b-40dc-be87-00de678e3f6e" containerName="revoke-keys"
Nov 02 18:06:41.826286 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.826274    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="33b24b30-f52b-40dc-be87-00de678e3f6e" containerName="revoke-keys"
Nov 02 18:06:41.830087 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.830070    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:41.838060 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.838035    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:06:41.838201 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.838118    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:06:41.838201 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.838160    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:06:41.838590 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.838569    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:06:41.840937 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.840916    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"]
Nov 02 18:06:41.950708 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.950672    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:41.950890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.950720    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:41.950890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:41.950742    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfg9\" (UniqueName: \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.051910 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.051866    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.052086 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.051930    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.052086 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.051963    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfg9\" (UniqueName: \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.052547 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.052526    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.054301 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.054281    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.062296 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.062275    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfg9\" (UniqueName: \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\") pod \"maas-api-revoke-sub-5a29efb3-kjm2p\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.146505 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.146440    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:42.438268 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.438099    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"]
Nov 02 18:06:42.570076 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:42.570036    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:43.342756 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:43.342712    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p" event={"ID":"5e43e7ec-8210-4519-92c7-7918a93cf96e","Type":"ContainerStarted","Data":"c692994a15309b152119180a77677cdadb4460dc74fd4a57d3c0d6c496854e8a"}
Nov 02 18:06:43.343542 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:43.342789    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p" event={"ID":"5e43e7ec-8210-4519-92c7-7918a93cf96e","Type":"ContainerStarted","Data":"58077262daf77ed26d71412b4312e3ea656fd8091871434fee23cb03380bb1ee"}
Nov 02 18:06:44.372395 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:44.372359    5054 generic.go:356] "Generic (PLEG): container finished" podID="5e43e7ec-8210-4519-92c7-7918a93cf96e" containerID="c692994a15309b152119180a77677cdadb4460dc74fd4a57d3c0d6c496854e8a" exitCode=0
Nov 02 18:06:44.373013 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:44.372986    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p" event={"ID":"5e43e7ec-8210-4519-92c7-7918a93cf96e","Type":"ContainerDied","Data":"c692994a15309b152119180a77677cdadb4460dc74fd4a57d3c0d6c496854e8a"}
Nov 02 18:06:46.000768 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:06:46.000727    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:06:46.052042 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.052023    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:46.129965 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.129923    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\" (UniqueName: \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\") pod \"5e43e7ec-8210-4519-92c7-7918a93cf96e\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") "
Nov 02 18:06:46.130176 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.130017    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\") pod \"5e43e7ec-8210-4519-92c7-7918a93cf96e\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") "
Nov 02 18:06:46.130176 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.130138    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\") pod \"5e43e7ec-8210-4519-92c7-7918a93cf96e\" (UID: \"5e43e7ec-8210-4519-92c7-7918a93cf96e\") "
Nov 02 18:06:46.130962 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.130928    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca" pod "5e43e7ec-8210-4519-92c7-7918a93cf96e" (UID: "5e43e7ec-8210-4519-92c7-7918a93cf96e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:06:46.133258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.133232    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9" pod "5e43e7ec-8210-4519-92c7-7918a93cf96e" (UID: "5e43e7ec-8210-4519-92c7-7918a93cf96e"). InnerVolumeSpecName "kube-api-access-2pfg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:06:46.140313 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.140260    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca" pod "5e43e7ec-8210-4519-92c7-7918a93cf96e" (UID: "5e43e7ec-8210-4519-92c7-7918a93cf96e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:06:46.231808 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.231776    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:46.231808 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.231811    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfg9\" (UniqueName: \"kubernetes.io/projected/5e43e7ec-8210-4519-92c7-7918a93cf96e-kube-api-access-2pfg9\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:46.232026 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.231827    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e43e7ec-8210-4519-92c7-7918a93cf96e-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:06:46.404372 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.404287    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"
Nov 02 18:06:46.404372 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.404307    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p" event={"ID":"5e43e7ec-8210-4519-92c7-7918a93cf96e","Type":"ContainerDied","Data":"58077262daf77ed26d71412b4312e3ea656fd8091871434fee23cb03380bb1ee"}
Nov 02 18:06:46.404372 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:46.404354    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58077262daf77ed26d71412b4312e3ea656fd8091871434fee23cb03380bb1ee"
Nov 02 18:06:52.637296 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:52.637257    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:06:57.201513 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.201479    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"]
Nov 02 18:06:57.207036 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.207011    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tz22x"]
Nov 02 18:06:57.225781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.225743    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"]
Nov 02 18:06:57.227131 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.227106    5054 cpu_manager.go:414] "containerMap: removing container" podUID="5e43e7ec-8210-4519-92c7-7918a93cf96e" containerName="revoke-keys"
Nov 02 18:06:57.227295 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.227281    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e43e7ec-8210-4519-92c7-7918a93cf96e" containerName="revoke-keys"
Nov 02 18:06:57.227683 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.227669    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e43e7ec-8210-4519-92c7-7918a93cf96e" containerName="revoke-keys"
Nov 02 18:06:57.232111 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.232091    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.238226 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.238205    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:06:57.238507 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.238482    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:06:57.242267 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.242242    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"]
Nov 02 18:06:57.260890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.254305    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:06:57.260890 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.254449    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:06:57.344693 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.344653    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.344922 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.344816    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.344996 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.344970    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99klg\" (UniqueName: \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.446508 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.446471    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.446712 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.446581    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.446712 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.446636    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99klg\" (UniqueName: \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.447288 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.447262    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.449037 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.449017    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.456953 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.456898    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99klg\" (UniqueName: \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\") pod \"maas-api-revoke-sub-3d4156f1-stnwb\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.558386 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.558351    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:06:57.840577 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:57.840549    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"]
Nov 02 18:06:57.841951 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:06:57.841925    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2aa32e_1f18_4f5a_ae40_0801b9750d79.slice/crio-a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8 WatchSource:0}: Error finding container a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8: Status 404 returned error can't find the container with id a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8
Nov 02 18:06:58.478734 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:58.478658    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb" event={"ID":"4d2aa32e-1f18-4f5a-ae40-0801b9750d79","Type":"ContainerStarted","Data":"216385450e60d1127d577c7ebaccc813f049ae0c225b52e57bbb021bcdd2b618"}
Nov 02 18:06:58.478734 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:58.478711    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb" event={"ID":"4d2aa32e-1f18-4f5a-ae40-0801b9750d79","Type":"ContainerStarted","Data":"a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8"}
Nov 02 18:06:58.497792 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:58.497746    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb" podStartSLOduration=1.497732962 podStartE2EDuration="1.497732962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:06:58.495459192 +0000 UTC m=+1622.004221258" watchObservedRunningTime="2026-11-02 18:06:58.497732962 +0000 UTC m=+1622.006495028"
Nov 02 18:06:58.618217 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:58.618179    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="925ce8b5-711d-4f57-bde4-75df84bbe190" path="/var/lib/kubelet/pods/925ce8b5-711d-4f57-bde4-75df84bbe190/volumes"
Nov 02 18:06:59.488438 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:59.488402    5054 generic.go:356] "Generic (PLEG): container finished" podID="4d2aa32e-1f18-4f5a-ae40-0801b9750d79" containerID="216385450e60d1127d577c7ebaccc813f049ae0c225b52e57bbb021bcdd2b618" exitCode=0
Nov 02 18:06:59.488875 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:06:59.488483    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb" event={"ID":"4d2aa32e-1f18-4f5a-ae40-0801b9750d79","Type":"ContainerDied","Data":"216385450e60d1127d577c7ebaccc813f049ae0c225b52e57bbb021bcdd2b618"}
Nov 02 18:07:00.642589 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.642563    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:07:00.781312 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.781238    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\") pod \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") "
Nov 02 18:07:00.781465 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.781329    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\") pod \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") "
Nov 02 18:07:00.781465 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.781356    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\" (UniqueName: \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\") pod \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\" (UID: \"4d2aa32e-1f18-4f5a-ae40-0801b9750d79\") "
Nov 02 18:07:00.781677 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.781631    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca" pod "4d2aa32e-1f18-4f5a-ae40-0801b9750d79" (UID: "4d2aa32e-1f18-4f5a-ae40-0801b9750d79"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:07:00.783588 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.783559    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca" pod "4d2aa32e-1f18-4f5a-ae40-0801b9750d79" (UID: "4d2aa32e-1f18-4f5a-ae40-0801b9750d79"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:07:00.783681 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.783610    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg" pod "4d2aa32e-1f18-4f5a-ae40-0801b9750d79" (UID: "4d2aa32e-1f18-4f5a-ae40-0801b9750d79"). InnerVolumeSpecName "kube-api-access-99klg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:07:00.882967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.882936    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:07:00.882967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.882963    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:07:00.882967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:00.882972    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99klg\" (UniqueName: \"kubernetes.io/projected/4d2aa32e-1f18-4f5a-ae40-0801b9750d79-kube-api-access-99klg\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:07:01.502587 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:01.502554    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"
Nov 02 18:07:01.502742 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:01.502584    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb" event={"ID":"4d2aa32e-1f18-4f5a-ae40-0801b9750d79","Type":"ContainerDied","Data":"a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8"}
Nov 02 18:07:01.502742 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:01.502656    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1c49b54e36fd863d71b468da7854a51248cd4dd590858a4c289ee33bb3cd2f8"
Nov 02 18:07:15.837867 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:07:15.837797    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:07:17.165878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.165831    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:07:17.166298 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.166276    5054 cpu_manager.go:414] "containerMap: removing container" podUID="4d2aa32e-1f18-4f5a-ae40-0801b9750d79" containerName="revoke-keys"
Nov 02 18:07:17.166298 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.166287    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d2aa32e-1f18-4f5a-ae40-0801b9750d79" containerName="revoke-keys"
Nov 02 18:07:17.166385 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.166372    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d2aa32e-1f18-4f5a-ae40-0801b9750d79" containerName="revoke-keys"
Nov 02 18:07:17.169886 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.169864    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.179696 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.179663    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:07:17.179810 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.179776    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:07:17.182522 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.182502    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-836cee-serving-cert\""
Nov 02 18:07:17.182522 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.182511    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 18:07:17.182671 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.182539    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-szhm5\""
Nov 02 18:07:17.192030 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.192010    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:07:17.240732 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.240694    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.240917 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.240745    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.240970 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.240910    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w5kq\" (UniqueName: \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.240970 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.240960    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.341717 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.341669    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.341970 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.341752    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.341970 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.341896    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w5kq\" (UniqueName: \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.341970 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.341948    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.342694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.342663    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.344780 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.344751    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.344926 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.344859    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.359633 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.359600    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w5kq\" (UniqueName: \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\") pod \"maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.484279 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.484199    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:17.782336 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.782305    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:07:17.784998 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:07:17.784964    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cb6806_b8d8_422b_af97_2b4ef65d81e4.slice/crio-c1c0046bae58d50f7d42a48e2570a97c700a2274e2b12a02d49194366d94d493 WatchSource:0}: Error finding container c1c0046bae58d50f7d42a48e2570a97c700a2274e2b12a02d49194366d94d493: Status 404 returned error can't find the container with id c1c0046bae58d50f7d42a48e2570a97c700a2274e2b12a02d49194366d94d493
Nov 02 18:07:17.786420 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:17.786401    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 18:07:18.616781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:18.616692    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" event={"ID":"18cb6806-b8d8-422b-af97-2b4ef65d81e4","Type":"ContainerStarted","Data":"abd6e25f660730c815183dac457ef3ee332ae8c465f12c312edd6b2dfd25f11f"}
Nov 02 18:07:18.616781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:18.616746    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:18.616781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:18.616773    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" event={"ID":"18cb6806-b8d8-422b-af97-2b4ef65d81e4","Type":"ContainerStarted","Data":"c1c0046bae58d50f7d42a48e2570a97c700a2274e2b12a02d49194366d94d493"}
Nov 02 18:07:18.638792 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:18.638737    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" podStartSLOduration=1.200407097 podStartE2EDuration="1.638723673s" totalImagesPullingTime="438.316576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:07:18.637795989 +0000 UTC m=+1642.146558057" watchObservedRunningTime="2026-11-02 18:07:18.638723673 +0000 UTC m=+1642.147485746"
Nov 02 18:07:19.095798 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.095759    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:07:19.828302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.828266    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:07:19.832238 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.832215    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.843865 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.843823    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:07:19.875521 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.875487    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.875692 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.875555    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwgb7\" (UniqueName: \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.916694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.916658    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-1637c359-dockercfg-wf29k\""
Nov 02 18:07:19.917116 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.917063    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-836cee\""
Nov 02 18:07:19.977562 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.977520    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.977752 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.977657    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwgb7\" (UniqueName: \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.978532 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.978508    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:19.989259 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:19.989228    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwgb7\" (UniqueName: \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\") pod \"payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:20.147196 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.147110    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:20.425475 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.425447    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:07:20.427322 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:07:20.427279    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31f6841_ce10_444d_b77f_33f74ac14276.slice/crio-e80415bcca57c818bc7ed7fa9f0e58d1c16da366d5227c89d9e1d40652266ae2 WatchSource:0}: Error finding container e80415bcca57c818bc7ed7fa9f0e58d1c16da366d5227c89d9e1d40652266ae2: Status 404 returned error can't find the container with id e80415bcca57c818bc7ed7fa9f0e58d1c16da366d5227c89d9e1d40652266ae2
Nov 02 18:07:20.641248 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.641201    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" event={"ID":"c31f6841-ce10-444d-b77f-33f74ac14276","Type":"ContainerStarted","Data":"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"}
Nov 02 18:07:20.641464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.641283    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" event={"ID":"c31f6841-ce10-444d-b77f-33f74ac14276","Type":"ContainerStarted","Data":"e80415bcca57c818bc7ed7fa9f0e58d1c16da366d5227c89d9e1d40652266ae2"}
Nov 02 18:07:20.641464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.641410    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:20.659410 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:20.659353    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" podStartSLOduration=1.659334055 podStartE2EDuration="1.659334055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:07:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:07:20.658175849 +0000 UTC m=+1644.166937946" watchObservedRunningTime="2026-11-02 18:07:20.659334055 +0000 UTC m=+1644.168096123"
Nov 02 18:07:24.626613 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:24.626584    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:07:31.651021 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:31.650983    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:07:44.944249 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.944165    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:07:44.948391 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.948367    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:44.961562 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.961537    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:07:44.962133 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.962113    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-836cee\"/\"default-dockercfg-498tc\""
Nov 02 18:07:44.964634 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.964615    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-836cee\"/\"simulator-single-main-836cee-kserve-self-signed-certs\""
Nov 02 18:07:44.969196 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.969175    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-836cee\"/\"openshift-service-ca.crt\""
Nov 02 18:07:44.969321 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:44.969239    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-836cee\"/\"kube-root-ca.crt\""
Nov 02 18:07:45.043264 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043237    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.043264 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043267    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.043435 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043375    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtnc\" (UniqueName: \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.043435 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043415    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.043557 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043513    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.043557 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.043533    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145013    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145112    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145143    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145202    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145228    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145313    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtnc\" (UniqueName: \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145454    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145721    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.146005 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.145941    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.149181 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.149140    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.150326 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.150292    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.158325 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.158296    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtnc\" (UniqueName: \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\") pod \"simulator-single-main-836cee-kserve-d47c74854-7sts7\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") " pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.262037 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.261948    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:45.539869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.539817    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:07:45.541341 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:07:45.541312    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab7901c_fa66_42a8_8873_714f21c9c7de.slice/crio-25e1cc57c532a5aa62851eca363ebdd07cabada9bc92c57f2cb58dc5958542df WatchSource:0}: Error finding container 25e1cc57c532a5aa62851eca363ebdd07cabada9bc92c57f2cb58dc5958542df: Status 404 returned error can't find the container with id 25e1cc57c532a5aa62851eca363ebdd07cabada9bc92c57f2cb58dc5958542df
Nov 02 18:07:45.798720 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.798634    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" event={"ID":"9ab7901c-fa66-42a8-8873-714f21c9c7de","Type":"ContainerStarted","Data":"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"}
Nov 02 18:07:45.798720 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.798686    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" event={"ID":"9ab7901c-fa66-42a8-8873-714f21c9c7de","Type":"ContainerStarted","Data":"25e1cc57c532a5aa62851eca363ebdd07cabada9bc92c57f2cb58dc5958542df"}
Nov 02 18:07:45.817887 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:45.817822    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" podStartSLOduration=1.8178085670000002 podStartE2EDuration="1.817808567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:07:45.815128397 +0000 UTC m=+1669.323890465" watchObservedRunningTime="2026-11-02 18:07:45.817808567 +0000 UTC m=+1669.326570634"
Nov 02 18:07:45.836399 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:07:45.836364    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:07:46.262928 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:46.262891    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:46.673224 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:46.673185    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:07:55.262748 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:55.262705    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:55.274613 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:55.274589    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:07:55.873493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:07:55.873461    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:08:02.569717 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:02.569684    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:08:15.835028 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:08:15.834990    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:08:26.584846 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:26.584793    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:08:30.660034 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:30.659997    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:08:35.975533 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:35.975497    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:08:36.965261 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:36.965221    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:08:36.965485 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:36.965435    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" podUID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" containerName="maas-api" containerID="cri-o://abd6e25f660730c815183dac457ef3ee332ae8c465f12c312edd6b2dfd25f11f" gracePeriod=30
Nov 02 18:08:37.108232 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.108193    5054 generic.go:356] "Generic (PLEG): container finished" podID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" containerID="abd6e25f660730c815183dac457ef3ee332ae8c465f12c312edd6b2dfd25f11f" exitCode=0
Nov 02 18:08:37.108608 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.108243    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" event={"ID":"18cb6806-b8d8-422b-af97-2b4ef65d81e4","Type":"ContainerDied","Data":"abd6e25f660730c815183dac457ef3ee332ae8c465f12c312edd6b2dfd25f11f"}
Nov 02 18:08:37.249115 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.249082    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:08:37.277747 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.277713    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\") pod \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") "
Nov 02 18:08:37.277939 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.277781    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\" (UniqueName: \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\") pod \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") "
Nov 02 18:08:37.278012 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.277990    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\") pod \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") "
Nov 02 18:08:37.278073 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.278062    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\") pod \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\" (UID: \"18cb6806-b8d8-422b-af97-2b4ef65d81e4\") "
Nov 02 18:08:37.278533 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.278496    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca" pod "18cb6806-b8d8-422b-af97-2b4ef65d81e4" (UID: "18cb6806-b8d8-422b-af97-2b4ef65d81e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:08:37.280499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.280469    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls" pod "18cb6806-b8d8-422b-af97-2b4ef65d81e4" (UID: "18cb6806-b8d8-422b-af97-2b4ef65d81e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:08:37.281041 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.281009    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs" pod "18cb6806-b8d8-422b-af97-2b4ef65d81e4" (UID: "18cb6806-b8d8-422b-af97-2b4ef65d81e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:08:37.281269 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.281245    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq" pod "18cb6806-b8d8-422b-af97-2b4ef65d81e4" (UID: "18cb6806-b8d8-422b-af97-2b4ef65d81e4"). InnerVolumeSpecName "kube-api-access-7w5kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:08:37.379373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.379278    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:37.379373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.379316    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w5kq\" (UniqueName: \"kubernetes.io/projected/18cb6806-b8d8-422b-af97-2b4ef65d81e4-kube-api-access-7w5kq\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:37.379373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.379333    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18cb6806-b8d8-422b-af97-2b4ef65d81e4-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:37.379373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:37.379347    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18cb6806-b8d8-422b-af97-2b4ef65d81e4-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:38.115883 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.115828    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"
Nov 02 18:08:38.115883 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.115865    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz" event={"ID":"18cb6806-b8d8-422b-af97-2b4ef65d81e4","Type":"ContainerDied","Data":"c1c0046bae58d50f7d42a48e2570a97c700a2274e2b12a02d49194366d94d493"}
Nov 02 18:08:38.116426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.115946    5054 scope.go:122] "RemoveContainer" containerID="abd6e25f660730c815183dac457ef3ee332ae8c465f12c312edd6b2dfd25f11f"
Nov 02 18:08:38.139311 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.139284    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:08:38.143234 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.143211    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-836cee-5dfd8766d6-qckbz"]
Nov 02 18:08:38.616912 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.616880    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" path="/var/lib/kubelet/pods/18cb6806-b8d8-422b-af97-2b4ef65d81e4/volumes"
Nov 02 18:08:38.658746 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:38.658701    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:08:40.976429 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:40.976380    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing" containerID="cri-o://28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba" gracePeriod=25
Nov 02 18:08:41.648586 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:41.648552    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:08:45.495787 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:45.495740    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"]
Nov 02 18:08:45.500455 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:45.500424    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-stnwb"]
Nov 02 18:08:45.680224 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:45.680183    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerName="main" containerID="cri-o://7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7" gracePeriod=45
Nov 02 18:08:45.836964 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:08:45.836915    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:08:45.942482 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:45.942456    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:08:46.074021 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.073926    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074021 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.073978    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074039    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074127    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074159    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\" (UniqueName: \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074208    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\") pod \"9ab7901c-fa66-42a8-8873-714f21c9c7de\" (UID: \"9ab7901c-fa66-42a8-8873-714f21c9c7de\") "
Nov 02 18:08:46.074483 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074303    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:08:46.074483 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074434    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:08:46.074697 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074666    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:08:46.074859 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074756    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.074859 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.074781    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.076505 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.076484    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:08:46.076699 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.076680    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:08:46.076758 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.076713    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc" pod "9ab7901c-fa66-42a8-8873-714f21c9c7de" (UID: "9ab7901c-fa66-42a8-8873-714f21c9c7de"). InnerVolumeSpecName "kube-api-access-sbtnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:08:46.171880 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.171833    5054 generic.go:356] "Generic (PLEG): container finished" podID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerID="7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7" exitCode=0
Nov 02 18:08:46.172042 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.171891    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" event={"ID":"9ab7901c-fa66-42a8-8873-714f21c9c7de","Type":"ContainerDied","Data":"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"}
Nov 02 18:08:46.172042 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.171921    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"
Nov 02 18:08:46.172042 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.171937    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" event={"ID":"9ab7901c-fa66-42a8-8873-714f21c9c7de","Type":"ContainerDied","Data":"25e1cc57c532a5aa62851eca363ebdd07cabada9bc92c57f2cb58dc5958542df"}
Nov 02 18:08:46.172042 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.171955    5054 scope.go:122] "RemoveContainer" containerID="7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"
Nov 02 18:08:46.176950 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.176925    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab7901c-fa66-42a8-8873-714f21c9c7de-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.176950 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.176949    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbtnc\" (UniqueName: \"kubernetes.io/projected/9ab7901c-fa66-42a8-8873-714f21c9c7de-kube-api-access-sbtnc\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.177097 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.176959    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.177097 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.176967    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab7901c-fa66-42a8-8873-714f21c9c7de-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:08:46.182725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.182705    5054 scope.go:122] "RemoveContainer" containerID="7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"
Nov 02 18:08:46.183014 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:08:46.182995    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7\": container with ID starting with 7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7 not found: ID does not exist" containerID="7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"
Nov 02 18:08:46.183072 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.183023    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7"} err="failed to get container status \"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7\": rpc error: code = NotFound desc = could not find container \"7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7\": container with ID starting with 7021cc7e3342eea4f932583d557032c30fda5a85aecae850680c739cd491ffe7 not found: ID does not exist"
Nov 02 18:08:46.195314 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.195291    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:08:46.201666 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.201635    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7"]
Nov 02 18:08:46.615800 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.615756    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d2aa32e-1f18-4f5a-ae40-0801b9750d79" path="/var/lib/kubelet/pods/4d2aa32e-1f18-4f5a-ae40-0801b9750d79/volumes"
Nov 02 18:08:46.616399 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.616378    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" path="/var/lib/kubelet/pods/9ab7901c-fa66-42a8-8873-714f21c9c7de/volumes"
Nov 02 18:08:46.863694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:46.863652    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-836cee/simulator-single-main-836cee-kserve-d47c74854-7sts7" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerName="main" probeResult="failure" output="Get \"https://10.132.0.123:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:08:51.648593 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:51.648555    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 18:08:56.542216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:08:56.542177    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:09:00.846004 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:00.845969    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:09:01.239275 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.239243    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:09:01.350758 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.350714    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\" (UniqueName: \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\") pod \"c31f6841-ce10-444d-b77f-33f74ac14276\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") "
Nov 02 18:09:01.350954 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.350825    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\") pod \"c31f6841-ce10-444d-b77f-33f74ac14276\" (UID: \"c31f6841-ce10-444d-b77f-33f74ac14276\") "
Nov 02 18:09:01.351298 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.351273    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume" pod "c31f6841-ce10-444d-b77f-33f74ac14276" (UID: "c31f6841-ce10-444d-b77f-33f74ac14276"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:09:01.353103 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.353072    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7" pod "c31f6841-ce10-444d-b77f-33f74ac14276" (UID: "c31f6841-ce10-444d-b77f-33f74ac14276"). InnerVolumeSpecName "kube-api-access-cwgb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:09:01.362435 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.362409    5054 generic.go:356] "Generic (PLEG): container finished" podID="c31f6841-ce10-444d-b77f-33f74ac14276" containerID="28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba" exitCode=0
Nov 02 18:09:01.362537 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.362447    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" event={"ID":"c31f6841-ce10-444d-b77f-33f74ac14276","Type":"ContainerDied","Data":"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"}
Nov 02 18:09:01.362537 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.362457    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"
Nov 02 18:09:01.362537 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.362488    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87" event={"ID":"c31f6841-ce10-444d-b77f-33f74ac14276","Type":"ContainerDied","Data":"e80415bcca57c818bc7ed7fa9f0e58d1c16da366d5227c89d9e1d40652266ae2"}
Nov 02 18:09:01.362537 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.362508    5054 scope.go:122] "RemoveContainer" containerID="28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"
Nov 02 18:09:01.373036 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.373010    5054 scope.go:122] "RemoveContainer" containerID="28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"
Nov 02 18:09:01.373313 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:09:01.373292    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba\": container with ID starting with 28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba not found: ID does not exist" containerID="28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"
Nov 02 18:09:01.373391 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.373321    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba"} err="failed to get container status \"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba\": rpc error: code = NotFound desc = could not find container \"28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba\": container with ID starting with 28f319213123d3cc8ed7abc8541c7b2e4751fc824a1c7ccc0348ede79560dcba not found: ID does not exist"
Nov 02 18:09:01.385831 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.385804    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:09:01.388178 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.388154    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-836cee-69cf8c494k8c87"]
Nov 02 18:09:01.452582 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.452546    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwgb7\" (UniqueName: \"kubernetes.io/projected/c31f6841-ce10-444d-b77f-33f74ac14276-kube-api-access-cwgb7\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:09:01.452582 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:01.452575    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31f6841-ce10-444d-b77f-33f74ac14276-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:09:02.615636 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:02.615606    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" path="/var/lib/kubelet/pods/c31f6841-ce10-444d-b77f-33f74ac14276/volumes"
Nov 02 18:09:15.835321 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:09:15.835285    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:09:17.270615 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.270576    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 18:09:17.271184 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.270895    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" podUID="28096a18-58c4-4c3e-80f9-df85c4f38199" containerName="manager" containerID="cri-o://f5f6911f653e01ad8e0a34b4a11ab230dbd95c6ab8abfc3e0637a45b416a1156" gracePeriod=10
Nov 02 18:09:17.460954 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.460917    5054 generic.go:356] "Generic (PLEG): container finished" podID="28096a18-58c4-4c3e-80f9-df85c4f38199" containerID="f5f6911f653e01ad8e0a34b4a11ab230dbd95c6ab8abfc3e0637a45b416a1156" exitCode=0
Nov 02 18:09:17.461122 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.460992    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" event={"ID":"28096a18-58c4-4c3e-80f9-df85c4f38199","Type":"ContainerDied","Data":"f5f6911f653e01ad8e0a34b4a11ab230dbd95c6ab8abfc3e0637a45b416a1156"}
Nov 02 18:09:17.539607 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.539580    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 18:09:17.606161 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.606129    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\" (UniqueName: \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\") pod \"28096a18-58c4-4c3e-80f9-df85c4f38199\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") "
Nov 02 18:09:17.606365 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.606216    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\") pod \"28096a18-58c4-4c3e-80f9-df85c4f38199\" (UID: \"28096a18-58c4-4c3e-80f9-df85c4f38199\") "
Nov 02 18:09:17.606794 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.606760    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume" pod "28096a18-58c4-4c3e-80f9-df85c4f38199" (UID: "28096a18-58c4-4c3e-80f9-df85c4f38199"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:09:17.608358 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.608330    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj" pod "28096a18-58c4-4c3e-80f9-df85c4f38199" (UID: "28096a18-58c4-4c3e-80f9-df85c4f38199"). InnerVolumeSpecName "kube-api-access-trrcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:09:17.707869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.707807    5054 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28096a18-58c4-4c3e-80f9-df85c4f38199-extensions-socket-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:09:17.707869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:17.707862    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trrcj\" (UniqueName: \"kubernetes.io/projected/28096a18-58c4-4c3e-80f9-df85c4f38199-kube-api-access-trrcj\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:09:18.468228 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.468194    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"
Nov 02 18:09:18.468666 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.468223    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw" event={"ID":"28096a18-58c4-4c3e-80f9-df85c4f38199","Type":"ContainerDied","Data":"cda8636f43bbda148477d70b1d7ac8eaca168ce99dd62cbcb368b2bfca9deb3b"}
Nov 02 18:09:18.468666 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.468332    5054 scope.go:122] "RemoveContainer" containerID="f5f6911f653e01ad8e0a34b4a11ab230dbd95c6ab8abfc3e0637a45b416a1156"
Nov 02 18:09:18.491201 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.491177    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 18:09:18.497510 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.497487    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gkvzw"]
Nov 02 18:09:18.615595 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:18.615562    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28096a18-58c4-4c3e-80f9-df85c4f38199" path="/var/lib/kubelet/pods/28096a18-58c4-4c3e-80f9-df85c4f38199/volumes"
Nov 02 18:09:45.835263 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:09:45.835224    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:09:56.920341 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:56.920308    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:09:56.923383 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:56.923360    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:09:56.929346 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:56.929326    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:09:56.932284 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:09:56.932266    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:10:15.835429 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:10:15.835391    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:10:18.268114 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268079    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"]
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268524    5054 cpu_manager.go:414] "containerMap: removing container" podUID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" containerName="maas-api"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268536    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" containerName="maas-api"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268546    5054 cpu_manager.go:414] "containerMap: removing container" podUID="28096a18-58c4-4c3e-80f9-df85c4f38199" containerName="manager"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268551    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28096a18-58c4-4c3e-80f9-df85c4f38199" containerName="manager"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268559    5054 cpu_manager.go:414] "containerMap: removing container" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268564    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268577    5054 cpu_manager.go:414] "containerMap: removing container" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerName="main"
Nov 02 18:10:18.268592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268582    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerName="main"
Nov 02 18:10:18.268881 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268650    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ab7901c-fa66-42a8-8873-714f21c9c7de" containerName="main"
Nov 02 18:10:18.268881 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268665    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="18cb6806-b8d8-422b-af97-2b4ef65d81e4" containerName="maas-api"
Nov 02 18:10:18.268881 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268672    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="28096a18-58c4-4c3e-80f9-df85c4f38199" containerName="manager"
Nov 02 18:10:18.268881 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.268678    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="c31f6841-ce10-444d-b77f-33f74ac14276" containerName="payload-processing"
Nov 02 18:10:18.271788 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.271771    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.275370 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.275351    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hswfc\""
Nov 02 18:10:18.287920 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.287899    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"]
Nov 02 18:10:18.404984 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.404947    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxg2x\" (UniqueName: \"kubernetes.io/projected/0260a82c-bf59-43d6-aaa0-de14507341dd-kube-api-access-xxg2x\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.405172 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.405011    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0260a82c-bf59-43d6-aaa0-de14507341dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.506302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.506263    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxg2x\" (UniqueName: \"kubernetes.io/projected/0260a82c-bf59-43d6-aaa0-de14507341dd-kube-api-access-xxg2x\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.506482 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.506316    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0260a82c-bf59-43d6-aaa0-de14507341dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.506705 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.506687    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0260a82c-bf59-43d6-aaa0-de14507341dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.515308 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.515283    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxg2x\" (UniqueName: \"kubernetes.io/projected/0260a82c-bf59-43d6-aaa0-de14507341dd-kube-api-access-xxg2x\") pod \"kuadrant-operator-controller-manager-678d87766f-bqc2p\" (UID: \"0260a82c-bf59-43d6-aaa0-de14507341dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.585612 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.585540    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:18.868361 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:18.868326    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"]
Nov 02 18:10:18.870400 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:10:18.870368    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0260a82c_bf59_43d6_aaa0_de14507341dd.slice/crio-ecce34d34383202893fceab3ab75a31df48cbb80bab25a223f71bdf7eceba068 WatchSource:0}: Error finding container ecce34d34383202893fceab3ab75a31df48cbb80bab25a223f71bdf7eceba068: Status 404 returned error can't find the container with id ecce34d34383202893fceab3ab75a31df48cbb80bab25a223f71bdf7eceba068
Nov 02 18:10:19.813757 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:19.813720    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p" event={"ID":"0260a82c-bf59-43d6-aaa0-de14507341dd","Type":"ContainerStarted","Data":"edb3bb3217dadb9c66239c4bd0f69a88cf2e1719a6ad5ddac1d3956b3d9cfcc9"}
Nov 02 18:10:19.814204 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:19.813773    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p" event={"ID":"0260a82c-bf59-43d6-aaa0-de14507341dd","Type":"ContainerStarted","Data":"ecce34d34383202893fceab3ab75a31df48cbb80bab25a223f71bdf7eceba068"}
Nov 02 18:10:19.814204 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:19.813871    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:19.835488 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:19.835439    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p" podStartSLOduration=1.83542468 podStartE2EDuration="1.83542468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:10:19.833076298 +0000 UTC m=+1823.341838366" watchObservedRunningTime="2026-11-02 18:10:19.83542468 +0000 UTC m=+1823.344186747"
Nov 02 18:10:30.822689 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:30.822651    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bqc2p"
Nov 02 18:10:35.024402 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:35.024363    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"]
Nov 02 18:10:35.026588 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:35.026564    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-mlwhz"]
Nov 02 18:10:36.616765 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:36.616728    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16b2c1c2-5d69-4df1-85e7-e654653797b2" path="/var/lib/kubelet/pods/16b2c1c2-5d69-4df1-85e7-e654653797b2/volumes"
Nov 02 18:10:37.864987 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:37.864910    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:10:41.241460 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:41.241420    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:10:41.242521 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:41.242082    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:10:41.261949 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:41.261923    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:10:41.262079 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:41.261962    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:10:42.354053 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.354012    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"]
Nov 02 18:10:42.359243 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.359221    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.365387 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.365361    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"]
Nov 02 18:10:42.365709 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.365675    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:10:42.365875 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.365734    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:10:42.365875 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.365757    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:10:42.365875 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.365801    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:10:42.394760 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.394722    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.394912 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.394829    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.394912 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.394865    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvv5h\" (UniqueName: \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.496097 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.496055    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.496302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.496111    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.496302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.496129    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvv5h\" (UniqueName: \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.496907 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.496882    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.498384 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.498362    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.504750 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.504725    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvv5h\" (UniqueName: \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\") pod \"maas-api-revoke-sub-d576e68b-wrfbw\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.676629 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.676597    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:42.951126 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:42.951100    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"]
Nov 02 18:10:43.000308 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:43.000271    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw" event={"ID":"8634a34a-c46e-4c2b-b326-da7d498c11b6","Type":"ContainerStarted","Data":"54c4f935ace3b498fd003b6bd57b2bbde5b7a6948a8042c10e3c0c84add1a01e"}
Nov 02 18:10:44.006788 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:44.006753    5054 generic.go:356] "Generic (PLEG): container finished" podID="8634a34a-c46e-4c2b-b326-da7d498c11b6" containerID="5e79edf09f4f1a1e1dacd6b59d4880c5fed3b3bb685a554d384cacc80e8d4c41" exitCode=0
Nov 02 18:10:44.007184 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:44.006848    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw" event={"ID":"8634a34a-c46e-4c2b-b326-da7d498c11b6","Type":"ContainerDied","Data":"5e79edf09f4f1a1e1dacd6b59d4880c5fed3b3bb685a554d384cacc80e8d4c41"}
Nov 02 18:10:45.172153 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.172127    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:45.222678 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.222645    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\" (UniqueName: \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\") pod \"8634a34a-c46e-4c2b-b326-da7d498c11b6\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") "
Nov 02 18:10:45.222878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.222688    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\") pod \"8634a34a-c46e-4c2b-b326-da7d498c11b6\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") "
Nov 02 18:10:45.222878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.222813    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\") pod \"8634a34a-c46e-4c2b-b326-da7d498c11b6\" (UID: \"8634a34a-c46e-4c2b-b326-da7d498c11b6\") "
Nov 02 18:10:45.223164 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.223143    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca" pod "8634a34a-c46e-4c2b-b326-da7d498c11b6" (UID: "8634a34a-c46e-4c2b-b326-da7d498c11b6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:10:45.223320 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.223304    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:10:45.224780 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.224757    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca" pod "8634a34a-c46e-4c2b-b326-da7d498c11b6" (UID: "8634a34a-c46e-4c2b-b326-da7d498c11b6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:10:45.224918 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.224898    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h" pod "8634a34a-c46e-4c2b-b326-da7d498c11b6" (UID: "8634a34a-c46e-4c2b-b326-da7d498c11b6"). InnerVolumeSpecName "kube-api-access-tvv5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:10:45.324865 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.324776    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvv5h\" (UniqueName: \"kubernetes.io/projected/8634a34a-c46e-4c2b-b326-da7d498c11b6-kube-api-access-tvv5h\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:10:45.324865 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:45.324801    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8634a34a-c46e-4c2b-b326-da7d498c11b6-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:10:45.835249 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:10:45.835210    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:10:46.019637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:46.019609    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"
Nov 02 18:10:46.019637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:46.019633    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw" event={"ID":"8634a34a-c46e-4c2b-b326-da7d498c11b6","Type":"ContainerDied","Data":"54c4f935ace3b498fd003b6bd57b2bbde5b7a6948a8042c10e3c0c84add1a01e"}
Nov 02 18:10:46.019834 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:46.019678    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54c4f935ace3b498fd003b6bd57b2bbde5b7a6948a8042c10e3c0c84add1a01e"
Nov 02 18:10:53.175868 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:53.175804    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:10:58.009549 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:10:58.009510    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:11:01.150439 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.150404    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"]
Nov 02 18:11:01.150952 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.150867    5054 cpu_manager.go:414] "containerMap: removing container" podUID="8634a34a-c46e-4c2b-b326-da7d498c11b6" containerName="revoke-keys"
Nov 02 18:11:01.150952 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.150879    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8634a34a-c46e-4c2b-b326-da7d498c11b6" containerName="revoke-keys"
Nov 02 18:11:01.151046 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.150973    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="8634a34a-c46e-4c2b-b326-da7d498c11b6" containerName="revoke-keys"
Nov 02 18:11:01.154520 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.154493    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.160524 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.160483    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:11:01.160642 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.160523    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:11:01.163500 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.163475    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"]
Nov 02 18:11:01.179994 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.174224    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:11:01.179994 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.174366    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:11:01.243985 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.243949    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.244167 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.244046    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92rdn\" (UniqueName: \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.244167 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.244111    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.345088 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.345053    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.345223 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.345171    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.345223 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.345203    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92rdn\" (UniqueName: \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.345694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.345670    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.347574 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.347553    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.353378 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.353355    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92rdn\" (UniqueName: \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\") pod \"maas-api-revoke-sub-d2bc93bc-7mcrq\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.479287 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.479256    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:01.754568 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:01.754542    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"]
Nov 02 18:11:01.756241 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:11:01.756210    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f109c0a_92b8_4c4b_8c5a_a9ef457174ff.slice/crio-634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad WatchSource:0}: Error finding container 634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad: Status 404 returned error can't find the container with id 634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad
Nov 02 18:11:02.157128 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:02.157078    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq" event={"ID":"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff","Type":"ContainerStarted","Data":"7ccd9a32583ca04245a8e384613a42f62318ac9da9e151eff5a623cd2eebc0b3"}
Nov 02 18:11:02.157634 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:02.157148    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq" event={"ID":"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff","Type":"ContainerStarted","Data":"634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad"}
Nov 02 18:11:02.173601 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:02.173551    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq" podStartSLOduration=1.173534467 podStartE2EDuration="1.173534467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:11:02.172435551 +0000 UTC m=+1865.681197623" watchObservedRunningTime="2026-11-02 18:11:02.173534467 +0000 UTC m=+1865.682296533"
Nov 02 18:11:03.166141 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:03.166107    5054 generic.go:356] "Generic (PLEG): container finished" podID="0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" containerID="7ccd9a32583ca04245a8e384613a42f62318ac9da9e151eff5a623cd2eebc0b3" exitCode=0
Nov 02 18:11:03.166637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:03.166193    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq" event={"ID":"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff","Type":"ContainerDied","Data":"7ccd9a32583ca04245a8e384613a42f62318ac9da9e151eff5a623cd2eebc0b3"}
Nov 02 18:11:04.316592 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.316563    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:04.479539 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.479453    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\") pod \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") "
Nov 02 18:11:04.479539 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.479520    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\" (UniqueName: \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\") pod \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") "
Nov 02 18:11:04.479765 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.479628    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\") pod \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\" (UID: \"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff\") "
Nov 02 18:11:04.480068 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.480035    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca" pod "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" (UID: "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:11:04.481630 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.481610    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca" pod "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" (UID: "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:11:04.481760 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.481735    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn" pod "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" (UID: "0f109c0a-92b8-4c4b-8c5a-a9ef457174ff"). InnerVolumeSpecName "kube-api-access-92rdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:11:04.581292 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.581263    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:11:04.581292 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.581289    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92rdn\" (UniqueName: \"kubernetes.io/projected/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-kube-api-access-92rdn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:11:04.581482 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:04.581301    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:11:05.180637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:05.180610    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"
Nov 02 18:11:05.180637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:05.180617    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq" event={"ID":"0f109c0a-92b8-4c4b-8c5a-a9ef457174ff","Type":"ContainerDied","Data":"634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad"}
Nov 02 18:11:05.180866 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:05.180659    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="634012f970a5349be33da8d5cd6c99f79717320df0377ed051a72a68737903ad"
Nov 02 18:11:11.959155 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:11.959104    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:11:15.835613 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:11:15.835576    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:11:17.434194 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.434145    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:11:17.435611 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.434931    5054 cpu_manager.go:414] "containerMap: removing container" podUID="0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" containerName="revoke-keys"
Nov 02 18:11:17.435611 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.434953    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" containerName="revoke-keys"
Nov 02 18:11:17.435611 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.435074    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" containerName="revoke-keys"
Nov 02 18:11:17.439803 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.439770    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.445216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.445192    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-e03252-serving-cert\""
Nov 02 18:11:17.446602 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.446579    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 18:11:17.446758 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.446707    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-szhm5\""
Nov 02 18:11:17.450682 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.450659    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:11:17.483546 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.483518    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:11:17.483710 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.483560    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:11:17.509265 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.509236    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.509419 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.509283    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.509419 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.509311    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9d9\" (UniqueName: \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.509528 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.509425    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.610641 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.610599    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9d9\" (UniqueName: \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.610641 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.610649    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.610975 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.610718    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.610975 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.610757    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.611457 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.611431    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.613257 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.613236    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.613257 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.613251    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.620993 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.620972    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9d9\" (UniqueName: \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\") pod \"maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:17.757049 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:17.756967    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:18.031508 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:18.031478    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:11:18.033104 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:11:18.033069    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd18d76c_afef_4111_a8f3_bf7f8c1e7b7d.slice/crio-4d910da15d2214f9be576014436329177cbaec38a4c26328b741654c61af3fa9 WatchSource:0}: Error finding container 4d910da15d2214f9be576014436329177cbaec38a4c26328b741654c61af3fa9: Status 404 returned error can't find the container with id 4d910da15d2214f9be576014436329177cbaec38a4c26328b741654c61af3fa9
Nov 02 18:11:18.276102 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:18.276059    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" event={"ID":"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d","Type":"ContainerStarted","Data":"4d910da15d2214f9be576014436329177cbaec38a4c26328b741654c61af3fa9"}
Nov 02 18:11:19.284508 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.284468    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" event={"ID":"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d","Type":"ContainerStarted","Data":"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"}
Nov 02 18:11:19.284969 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.284596    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:19.303691 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.303604    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" podStartSLOduration=1.892219986 podStartE2EDuration="2.303586842s" totalImagesPullingTime="411.366856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:11:19.302177661 +0000 UTC m=+1882.810939729" watchObservedRunningTime="2026-11-02 18:11:19.303586842 +0000 UTC m=+1882.812348909"
Nov 02 18:11:19.696493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.696460    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:11:19.700345 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.700322    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.710223 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.710188    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:11:19.734409 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.734383    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.734556 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.734445    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrmmt\" (UniqueName: \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.746939 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.746898    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-e03252\""
Nov 02 18:11:19.761058 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.761027    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-5b6769ba-dockercfg-hbdr4\""
Nov 02 18:11:19.772106 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.772077    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:11:19.835619 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.835573    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.835818 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.835717    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrmmt\" (UniqueName: \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.836916 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.836887    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:19.853819 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:19.853790    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrmmt\" (UniqueName: \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\") pod \"payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:20.018867 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:20.018771    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:20.303232 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:20.303188    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:11:20.304503 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:11:20.304473    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2848de_1b89_4a02_b55c_eda522469c32.slice/crio-1b2b8a19fd75cb52ef89bb7b1ce3c267799785035a94801543da750f3840cd61 WatchSource:0}: Error finding container 1b2b8a19fd75cb52ef89bb7b1ce3c267799785035a94801543da750f3840cd61: Status 404 returned error can't find the container with id 1b2b8a19fd75cb52ef89bb7b1ce3c267799785035a94801543da750f3840cd61
Nov 02 18:11:21.299200 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:21.299157    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" event={"ID":"dd2848de-1b89-4a02-b55c-eda522469c32","Type":"ContainerStarted","Data":"d17ff96fc0ac454330ff9cf4b85dcfd08ccf1371e490d86f2492b6ab5a3847d0"}
Nov 02 18:11:21.299402 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:21.299220    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" event={"ID":"dd2848de-1b89-4a02-b55c-eda522469c32","Type":"ContainerStarted","Data":"1b2b8a19fd75cb52ef89bb7b1ce3c267799785035a94801543da750f3840cd61"}
Nov 02 18:11:21.299402 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:21.299284    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:21.317982 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:21.317917    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" podStartSLOduration=2.317904298 podStartE2EDuration="2.317904298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:11:21.31679663 +0000 UTC m=+1884.825558696" watchObservedRunningTime="2026-11-02 18:11:21.317904298 +0000 UTC m=+1884.826666359"
Nov 02 18:11:25.296197 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:25.296167    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:11:32.310436 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:32.310407    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:11:35.020202 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:35.020171    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"]
Nov 02 18:11:35.022643 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:35.022621    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-9bbsd"]
Nov 02 18:11:36.617622 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:36.617587    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33b24b30-f52b-40dc-be87-00de678e3f6e" path="/var/lib/kubelet/pods/33b24b30-f52b-40dc-be87-00de678e3f6e/volumes"
Nov 02 18:11:40.033084 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.033046    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:11:40.038084 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.038060    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.047790 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.047763    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:11:40.047956 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.047819    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-e03252\"/\"kube-root-ca.crt\""
Nov 02 18:11:40.047956 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.047914    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-e03252\"/\"openshift-service-ca.crt\""
Nov 02 18:11:40.048073 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.047961    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-e03252\"/\"default-dockercfg-4hqps\""
Nov 02 18:11:40.048935 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.048917    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-e03252\"/\"simulator-single-main-e03252-kserve-self-signed-certs\""
Nov 02 18:11:40.145440 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145402    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.145631 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145449    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.145631 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145480    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvj2\" (UniqueName: \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.145631 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145607    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.145772 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145666    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.145819 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.145775    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247014 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.246972    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247210 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247027    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247210 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247047    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvj2\" (UniqueName: \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247338 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247219    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247338 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247263    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247455 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247350    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247650 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247623    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247800 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247714    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.247880 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.247797    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.249439 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.249415    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.249564 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.249459    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.254951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.254923    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvj2\" (UniqueName: \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\") pod \"simulator-single-main-e03252-kserve-768db99865-f42vc\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") " pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.352284 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.352209    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:40.629570 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:40.629547    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:11:40.631875 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:11:40.631828    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod903fdc33_dc17_4bef_bfb2_c003742483c0.slice/crio-7ac985826d221e8c7b78b46ca5bafb6f5d28b52e3a5b10e91bd03e14f9921fca WatchSource:0}: Error finding container 7ac985826d221e8c7b78b46ca5bafb6f5d28b52e3a5b10e91bd03e14f9921fca: Status 404 returned error can't find the container with id 7ac985826d221e8c7b78b46ca5bafb6f5d28b52e3a5b10e91bd03e14f9921fca
Nov 02 18:11:41.428688 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:41.428644    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" event={"ID":"903fdc33-dc17-4bef-bfb2-c003742483c0","Type":"ContainerStarted","Data":"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"}
Nov 02 18:11:41.429176 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:41.428701    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" event={"ID":"903fdc33-dc17-4bef-bfb2-c003742483c0","Type":"ContainerStarted","Data":"7ac985826d221e8c7b78b46ca5bafb6f5d28b52e3a5b10e91bd03e14f9921fca"}
Nov 02 18:11:41.447265 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:41.447216    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" podStartSLOduration=1.447203543 podStartE2EDuration="1.447203543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:11:41.445371617 +0000 UTC m=+1904.954133685" watchObservedRunningTime="2026-11-02 18:11:41.447203543 +0000 UTC m=+1904.955965611"
Nov 02 18:11:41.987799 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:41.987763    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:11:42.352982 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:42.352870    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:45.838353 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:11:45.838315    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:11:46.040418 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:46.040382    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"]
Nov 02 18:11:46.042686 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:46.042664    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-kjm2p"]
Nov 02 18:11:46.616208 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:46.616172    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e43e7ec-8210-4519-92c7-7918a93cf96e" path="/var/lib/kubelet/pods/5e43e7ec-8210-4519-92c7-7918a93cf96e/volumes"
Nov 02 18:11:50.352917 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:50.352881    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:50.365584 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:50.365559    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:50.500105 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:50.500074    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:11:57.847665 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:57.847625    5054 scope.go:122] "RemoveContainer" containerID="5a908a5ad5aa9c154d65973e4e21349d552e18e44ea6d16b14bd8253a1636b51"
Nov 02 18:11:57.858759 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:57.858727    5054 scope.go:122] "RemoveContainer" containerID="325425621d96eb0cf68e6f89d303e96b34ae78c1f81c70ef5ead6d063d327f83"
Nov 02 18:11:58.681977 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:11:58.681944    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:12:15.836092 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:12:15.836051    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:12:21.471997 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:21.471959    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:12:26.185656 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:26.185616    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:12:31.597489 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:31.597448    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:12:31.656405 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:31.656362    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:12:31.656698 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:31.656665    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" podUID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" containerName="maas-api" containerID="cri-o://15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f" gracePeriod=30
Nov 02 18:12:32.120645 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.120616    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:12:32.155779 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.155747    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\") pod \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") "
Nov 02 18:12:32.155986 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.155847    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\") pod \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") "
Nov 02 18:12:32.155986 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.155903    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\" (UniqueName: \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\") pod \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") "
Nov 02 18:12:32.155986 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.155927    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\") pod \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\" (UID: \"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d\") "
Nov 02 18:12:32.156318 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.156288    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca" pod "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" (UID: "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:12:32.158284 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.158251    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9" pod "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" (UID: "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d"). InnerVolumeSpecName "kube-api-access-bd9d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:12:32.158538 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.158517    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls" pod "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" (UID: "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:12:32.158591 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.158541    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs" pod "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" (UID: "bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:12:32.257643 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.257564    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd9d9\" (UniqueName: \"kubernetes.io/projected/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-kube-api-access-bd9d9\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:32.257643 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.257591    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:32.257643 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.257601    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:32.257643 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.257611    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:32.744385 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.744351    5054 generic.go:356] "Generic (PLEG): container finished" podID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" containerID="15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f" exitCode=0
Nov 02 18:12:32.744869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.744395    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"
Nov 02 18:12:32.744869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.744426    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" event={"ID":"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d","Type":"ContainerDied","Data":"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"}
Nov 02 18:12:32.744869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.744480    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk" event={"ID":"bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d","Type":"ContainerDied","Data":"4d910da15d2214f9be576014436329177cbaec38a4c26328b741654c61af3fa9"}
Nov 02 18:12:32.744869 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.744503    5054 scope.go:122] "RemoveContainer" containerID="15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"
Nov 02 18:12:32.754751 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.754723    5054 scope.go:122] "RemoveContainer" containerID="15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"
Nov 02 18:12:32.755028 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:12:32.755011    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f\": container with ID starting with 15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f not found: ID does not exist" containerID="15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"
Nov 02 18:12:32.755088 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.755035    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f"} err="failed to get container status \"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f\": rpc error: code = NotFound desc = could not find container \"15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f\": container with ID starting with 15f3e8c007ae078847f702cafb72f9791112fc7e4337d680fe5dca6273eb9e2f not found: ID does not exist"
Nov 02 18:12:32.762951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.762926    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:12:32.765191 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:32.765161    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e03252-6fd6d9666f-lscpk"]
Nov 02 18:12:33.263535 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:33.263499    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:12:34.617575 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:34.617530    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" path="/var/lib/kubelet/pods/bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d/volumes"
Nov 02 18:12:36.598389 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.598335    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" podUID="dd2848de-1b89-4a02-b55c-eda522469c32" containerName="payload-processing" containerID="cri-o://d17ff96fc0ac454330ff9cf4b85dcfd08ccf1371e490d86f2492b6ab5a3847d0" gracePeriod=25
Nov 02 18:12:36.772237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.772202    5054 generic.go:356] "Generic (PLEG): container finished" podID="dd2848de-1b89-4a02-b55c-eda522469c32" containerID="d17ff96fc0ac454330ff9cf4b85dcfd08ccf1371e490d86f2492b6ab5a3847d0" exitCode=0
Nov 02 18:12:36.772347 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.772308    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" event={"ID":"dd2848de-1b89-4a02-b55c-eda522469c32","Type":"ContainerDied","Data":"d17ff96fc0ac454330ff9cf4b85dcfd08ccf1371e490d86f2492b6ab5a3847d0"}
Nov 02 18:12:36.875912 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.875879    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:12:36.906602 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.906570    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\") pod \"dd2848de-1b89-4a02-b55c-eda522469c32\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") "
Nov 02 18:12:36.906797 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.906734    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\" (UniqueName: \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\") pod \"dd2848de-1b89-4a02-b55c-eda522469c32\" (UID: \"dd2848de-1b89-4a02-b55c-eda522469c32\") "
Nov 02 18:12:36.907031 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.907007    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume" pod "dd2848de-1b89-4a02-b55c-eda522469c32" (UID: "dd2848de-1b89-4a02-b55c-eda522469c32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:12:36.907116 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.907098    5054 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd2848de-1b89-4a02-b55c-eda522469c32-plugins-config-volume\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:36.908942 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:36.908914    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt" pod "dd2848de-1b89-4a02-b55c-eda522469c32" (UID: "dd2848de-1b89-4a02-b55c-eda522469c32"). InnerVolumeSpecName "kube-api-access-mrmmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:12:37.007717 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.007688    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrmmt\" (UniqueName: \"kubernetes.io/projected/dd2848de-1b89-4a02-b55c-eda522469c32-kube-api-access-mrmmt\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:37.779655 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.779623    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"
Nov 02 18:12:37.780124 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.779621    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb" event={"ID":"dd2848de-1b89-4a02-b55c-eda522469c32","Type":"ContainerDied","Data":"1b2b8a19fd75cb52ef89bb7b1ce3c267799785035a94801543da750f3840cd61"}
Nov 02 18:12:37.780124 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.779754    5054 scope.go:122] "RemoveContainer" containerID="d17ff96fc0ac454330ff9cf4b85dcfd08ccf1371e490d86f2492b6ab5a3847d0"
Nov 02 18:12:37.801658 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.801633    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:12:37.806183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:37.806161    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-e03252-68cd9897f7cdpb"]
Nov 02 18:12:38.615517 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:38.615481    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd2848de-1b89-4a02-b55c-eda522469c32" path="/var/lib/kubelet/pods/dd2848de-1b89-4a02-b55c-eda522469c32/volumes"
Nov 02 18:12:41.206366 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.206325    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" podUID="903fdc33-dc17-4bef-bfb2-c003742483c0" containerName="main" containerID="cri-o://53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a" gracePeriod=45
Nov 02 18:12:41.474311 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.474281    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:12:41.554589 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554552    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.554787 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554641    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\" (UniqueName: \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.554787 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554672    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.554787 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554706    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\" (UniqueName: \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.554787 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554769    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.555044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554798    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\") pod \"903fdc33-dc17-4bef-bfb2-c003742483c0\" (UID: \"903fdc33-dc17-4bef-bfb2-c003742483c0\") "
Nov 02 18:12:41.555044 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.554887    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:12:41.555150 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.555122    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:12:41.555350 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.555269    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.555350 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.555324    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.555350 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.555337    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:12:41.557177 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.557137    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:12:41.557285 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.557177    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:12:41.557285 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.557246    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2" pod "903fdc33-dc17-4bef-bfb2-c003742483c0" (UID: "903fdc33-dc17-4bef-bfb2-c003742483c0"). InnerVolumeSpecName "kube-api-access-rhvj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:12:41.656886 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.656821    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903fdc33-dc17-4bef-bfb2-c003742483c0-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.656886 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.656886    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.657116 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.656902    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhvj2\" (UniqueName: \"kubernetes.io/projected/903fdc33-dc17-4bef-bfb2-c003742483c0-kube-api-access-rhvj2\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.657116 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.656917    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903fdc33-dc17-4bef-bfb2-c003742483c0-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:12:41.804346 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.804254    5054 generic.go:356] "Generic (PLEG): container finished" podID="903fdc33-dc17-4bef-bfb2-c003742483c0" containerID="53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a" exitCode=0
Nov 02 18:12:41.804346 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.804306    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"
Nov 02 18:12:41.804586 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.804349    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" event={"ID":"903fdc33-dc17-4bef-bfb2-c003742483c0","Type":"ContainerDied","Data":"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"}
Nov 02 18:12:41.804586 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.804406    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc" event={"ID":"903fdc33-dc17-4bef-bfb2-c003742483c0","Type":"ContainerDied","Data":"7ac985826d221e8c7b78b46ca5bafb6f5d28b52e3a5b10e91bd03e14f9921fca"}
Nov 02 18:12:41.804586 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.804429    5054 scope.go:122] "RemoveContainer" containerID="53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"
Nov 02 18:12:41.814641 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.814625    5054 scope.go:122] "RemoveContainer" containerID="53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"
Nov 02 18:12:41.814963 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:12:41.814942    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a\": container with ID starting with 53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a not found: ID does not exist" containerID="53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"
Nov 02 18:12:41.815022 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.814972    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a"} err="failed to get container status \"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a\": rpc error: code = NotFound desc = could not find container \"53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a\": container with ID starting with 53ff01e38694abc3214b8c481409fc5adfced0fb42cd22ba82348a1dd12c5e9a not found: ID does not exist"
Nov 02 18:12:41.828442 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.828420    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:12:41.836116 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:41.836096    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-e03252/simulator-single-main-e03252-kserve-768db99865-f42vc"]
Nov 02 18:12:42.615253 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:42.615217    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="903fdc33-dc17-4bef-bfb2-c003742483c0" path="/var/lib/kubelet/pods/903fdc33-dc17-4bef-bfb2-c003742483c0/volumes"
Nov 02 18:12:43.757304 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757271    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:12:43.757775 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757756    5054 cpu_manager.go:414] "containerMap: removing container" podUID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" containerName="maas-api"
Nov 02 18:12:43.757873 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757776    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" containerName="maas-api"
Nov 02 18:12:43.757873 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757800    5054 cpu_manager.go:414] "containerMap: removing container" podUID="dd2848de-1b89-4a02-b55c-eda522469c32" containerName="payload-processing"
Nov 02 18:12:43.757873 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757805    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd2848de-1b89-4a02-b55c-eda522469c32" containerName="payload-processing"
Nov 02 18:12:43.757873 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757824    5054 cpu_manager.go:414] "containerMap: removing container" podUID="903fdc33-dc17-4bef-bfb2-c003742483c0" containerName="main"
Nov 02 18:12:43.757873 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757829    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="903fdc33-dc17-4bef-bfb2-c003742483c0" containerName="main"
Nov 02 18:12:43.758103 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757966    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd18d76c-afef-4111-a8f3-bf7f8c1e7b7d" containerName="maas-api"
Nov 02 18:12:43.758103 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.757984    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd2848de-1b89-4a02-b55c-eda522469c32" containerName="payload-processing"
Nov 02 18:12:43.758103 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.758001    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="903fdc33-dc17-4bef-bfb2-c003742483c0" containerName="main"
Nov 02 18:12:43.762736 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.762708    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.769735 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.769701    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-a6fb1955-kserve-self-signed-certs\""
Nov 02 18:12:43.770615 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.770589    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:12:43.877602 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.877557    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.877983 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.877954    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.878147 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.878126    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4p5\" (UniqueName: \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.878290 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.878274    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.878425 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.878409    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.878575 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.878502    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980097 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980059    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980097 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980103    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4p5\" (UniqueName: \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980355 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980139    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980355 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980174    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980355 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980224    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980355 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980256    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980646 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980619    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980691 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980651    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.980756 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.980735    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.982676 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.982649    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.982960 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.982939    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:43.988273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:43.988251    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4p5\" (UniqueName: \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\") pod \"e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") " pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:44.079293 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:44.079199    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:44.363201 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:44.363169    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:12:44.824722 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:44.824685    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" event={"ID":"544b0253-05cb-4747-bd92-6426ab122dd1","Type":"ContainerStarted","Data":"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"}
Nov 02 18:12:44.824722 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:44.824728    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" event={"ID":"544b0253-05cb-4747-bd92-6426ab122dd1","Type":"ContainerStarted","Data":"c77d35c3bbac0275732d503060a5ae8bedf8d378de9abffcbb7d3ab1e02d3022"}
Nov 02 18:12:44.843067 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:44.843014    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" podStartSLOduration=1.842990074 podStartE2EDuration="1.842990074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:12:44.840914374 +0000 UTC m=+1968.349676443" watchObservedRunningTime="2026-11-02 18:12:44.842990074 +0000 UTC m=+1968.351752141"
Nov 02 18:12:45.079969 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:45.079867    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:45.265683 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:45.265644    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:12:45.908200 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:12:45.908159    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:12:54.079323 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:54.079284    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:54.092142 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:54.092115    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:54.995905 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:54.995869    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:12:57.892049 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:57.892017    5054 scope.go:122] "RemoveContainer" containerID="216385450e60d1127d577c7ebaccc813f049ae0c225b52e57bbb021bcdd2b618"
Nov 02 18:12:57.901443 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:57.901424    5054 scope.go:122] "RemoveContainer" containerID="5e46b7dad131730234756a9918aea03238031ce85d34e1a9cbadc70fff416401"
Nov 02 18:12:57.910570 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:57.910539    5054 scope.go:122] "RemoveContainer" containerID="c692994a15309b152119180a77677cdadb4460dc74fd4a57d3c0d6c496854e8a"
Nov 02 18:12:57.918649 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:12:57.918628    5054 scope.go:122] "RemoveContainer" containerID="231ded58da83fc5e4c6f10db8ae9f1bbbea14f098a53506e8aab83722d26ffd3"
Nov 02 18:13:01.356517 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:01.356478    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:15.835291 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:13:15.835253    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:13:16.586183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.586145    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"]
Nov 02 18:13:16.591831 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.591809    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.597011 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.595937    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:13:16.597353 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.597321    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:13:16.597491 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.597468    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:13:16.598322 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.598299    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"]
Nov 02 18:13:16.673430 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.673390    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwldb\" (UniqueName: \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.673430 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.673433    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.673662 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.673516    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.696202 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.696165    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:13:16.774133 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.774088    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwldb\" (UniqueName: \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.774133 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.774137    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.774377 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.774186    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.774947 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.774924    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.776830 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.776807    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.784401 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.784372    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwldb\" (UniqueName: \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\") pod \"maas-api-revoke-sub-452b6d7b-9646w\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:16.908255 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:16.908154    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:17.190008 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:17.189966    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"]
Nov 02 18:13:17.191176 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:13:17.191146    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c189bc_3fdf_4b77_a95a_183075637ac5.slice/crio-ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f WatchSource:0}: Error finding container ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f: Status 404 returned error can't find the container with id ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f
Nov 02 18:13:17.284012 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:17.283980    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:18.174772 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:18.174715    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w" event={"ID":"d4c189bc-3fdf-4b77-a95a-183075637ac5","Type":"ContainerStarted","Data":"82b3315ba2fd6c001dc69445497e2358ee0e780f561db547efe2e52f8ee11c6b"}
Nov 02 18:13:18.175399 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:18.175372    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w" event={"ID":"d4c189bc-3fdf-4b77-a95a-183075637ac5","Type":"ContainerStarted","Data":"ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f"}
Nov 02 18:13:18.203647 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:18.203585    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w" podStartSLOduration=2.203444 podStartE2EDuration="2.203444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:13:18.199295695 +0000 UTC m=+2001.708057765" watchObservedRunningTime="2026-11-02 18:13:18.203444 +0000 UTC m=+2001.712206068"
Nov 02 18:13:19.210863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:19.210342    5054 generic.go:356] "Generic (PLEG): container finished" podID="d4c189bc-3fdf-4b77-a95a-183075637ac5" containerID="82b3315ba2fd6c001dc69445497e2358ee0e780f561db547efe2e52f8ee11c6b" exitCode=0
Nov 02 18:13:19.210863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:19.210501    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w" event={"ID":"d4c189bc-3fdf-4b77-a95a-183075637ac5","Type":"ContainerDied","Data":"82b3315ba2fd6c001dc69445497e2358ee0e780f561db547efe2e52f8ee11c6b"}
Nov 02 18:13:21.152474 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.152106    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:21.284951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.258988    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\") pod \"d4c189bc-3fdf-4b77-a95a-183075637ac5\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") "
Nov 02 18:13:21.284951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.259063    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\" (UniqueName: \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\") pod \"d4c189bc-3fdf-4b77-a95a-183075637ac5\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") "
Nov 02 18:13:21.284951 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.259097    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\") pod \"d4c189bc-3fdf-4b77-a95a-183075637ac5\" (UID: \"d4c189bc-3fdf-4b77-a95a-183075637ac5\") "
Nov 02 18:13:21.309961 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.285417    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca" pod "d4c189bc-3fdf-4b77-a95a-183075637ac5" (UID: "d4c189bc-3fdf-4b77-a95a-183075637ac5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:13:21.350488 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.350411    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb" pod "d4c189bc-3fdf-4b77-a95a-183075637ac5" (UID: "d4c189bc-3fdf-4b77-a95a-183075637ac5"). InnerVolumeSpecName "kube-api-access-zwldb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:13:21.376649 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.376521    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:21.376649 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.376591    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwldb\" (UniqueName: \"kubernetes.io/projected/d4c189bc-3fdf-4b77-a95a-183075637ac5-kube-api-access-zwldb\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:21.402781 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.402735    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca" pod "d4c189bc-3fdf-4b77-a95a-183075637ac5" (UID: "d4c189bc-3fdf-4b77-a95a-183075637ac5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:13:21.451562 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.451521    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w" event={"ID":"d4c189bc-3fdf-4b77-a95a-183075637ac5","Type":"ContainerDied","Data":"ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f"}
Nov 02 18:13:21.451860 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.451817    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac20356e82f91b154e6f3132f2a830aac32f604d4d86d5c916674f92149f358f"
Nov 02 18:13:21.459862 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.452066    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"
Nov 02 18:13:21.480796 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:21.479625    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4c189bc-3fdf-4b77-a95a-183075637ac5-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:27.410306 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:27.410270    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:13:28.745856 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:28.745801    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:32.948026 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.947984    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"]
Nov 02 18:13:32.948555 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.948493    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d4c189bc-3fdf-4b77-a95a-183075637ac5" containerName="revoke-keys"
Nov 02 18:13:32.948555 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.948506    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4c189bc-3fdf-4b77-a95a-183075637ac5" containerName="revoke-keys"
Nov 02 18:13:32.948700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.948585    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4c189bc-3fdf-4b77-a95a-183075637ac5" containerName="revoke-keys"
Nov 02 18:13:32.952028 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.951998    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:32.964882 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.957315    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:13:32.964882 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.957358    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:13:32.964882 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.957507    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:13:32.964882 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.957544    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:13:32.964882 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:32.961470    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"]
Nov 02 18:13:33.045074 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.044637    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.045074 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.044714    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.045074 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.044812    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg59m\" (UniqueName: \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.146502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.146383    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.146731 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.146582    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.146731 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.146639    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg59m\" (UniqueName: \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.147477 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.147444    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.149684 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.149654    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.159028 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.158985    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg59m\" (UniqueName: \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\") pod \"maas-api-revoke-sub-3e31a506-4jgsk\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.269316 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.269220    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:33.592064 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.581751    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"]
Nov 02 18:13:33.592064 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:13:33.583275    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e6144c_4ffb_47f2_b201_7379bd7e4be4.slice/crio-ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7 WatchSource:0}: Error finding container ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7: Status 404 returned error can't find the container with id ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7
Nov 02 18:13:33.607590 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:33.607548    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk" event={"ID":"f8e6144c-4ffb-47f2-b201-7379bd7e4be4","Type":"ContainerStarted","Data":"ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7"}
Nov 02 18:13:34.669810 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:34.669766    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk" event={"ID":"f8e6144c-4ffb-47f2-b201-7379bd7e4be4","Type":"ContainerStarted","Data":"82551d3a88fba9bb65d7181f3aa63cbe9995b791e0523b76c93fa3613fa0a51e"}
Nov 02 18:13:34.735861 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:34.735772    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk" podStartSLOduration=2.735752089 podStartE2EDuration="2.735752089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:13:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:13:34.735165293 +0000 UTC m=+2018.243927361" watchObservedRunningTime="2026-11-02 18:13:34.735752089 +0000 UTC m=+2018.244514156"
Nov 02 18:13:35.275867 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:35.274940    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:35.689274 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:35.689241    5054 generic.go:356] "Generic (PLEG): container finished" podID="f8e6144c-4ffb-47f2-b201-7379bd7e4be4" containerID="82551d3a88fba9bb65d7181f3aa63cbe9995b791e0523b76c93fa3613fa0a51e" exitCode=0
Nov 02 18:13:35.689955 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:35.689910    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk" event={"ID":"f8e6144c-4ffb-47f2-b201-7379bd7e4be4","Type":"ContainerDied","Data":"82551d3a88fba9bb65d7181f3aa63cbe9995b791e0523b76c93fa3613fa0a51e"}
Nov 02 18:13:36.855801 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.855772    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:36.906600 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.906547    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\") pod \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") "
Nov 02 18:13:36.906813 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.906708    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\") pod \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") "
Nov 02 18:13:36.906813 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.906778    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\" (UniqueName: \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\") pod \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\" (UID: \"f8e6144c-4ffb-47f2-b201-7379bd7e4be4\") "
Nov 02 18:13:36.907073 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.907041    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca" pod "f8e6144c-4ffb-47f2-b201-7379bd7e4be4" (UID: "f8e6144c-4ffb-47f2-b201-7379bd7e4be4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:13:36.909878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.909794    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m" pod "f8e6144c-4ffb-47f2-b201-7379bd7e4be4" (UID: "f8e6144c-4ffb-47f2-b201-7379bd7e4be4"). InnerVolumeSpecName "kube-api-access-bg59m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:13:36.909992 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:36.909912    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca" pod "f8e6144c-4ffb-47f2-b201-7379bd7e4be4" (UID: "f8e6144c-4ffb-47f2-b201-7379bd7e4be4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:13:37.008209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.008125    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:37.008209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.008166    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg59m\" (UniqueName: \"kubernetes.io/projected/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-kube-api-access-bg59m\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:37.008209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.008182    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6144c-4ffb-47f2-b201-7379bd7e4be4-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:37.704983 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.704943    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk" event={"ID":"f8e6144c-4ffb-47f2-b201-7379bd7e4be4","Type":"ContainerDied","Data":"ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7"}
Nov 02 18:13:37.705154 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.705016    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca53330a1a71ac428080367a63cb97a4e650303c5c0ce11faa6ad8b5036847b7"
Nov 02 18:13:37.705154 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:37.704948    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"
Nov 02 18:13:42.430886 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.430801    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" podUID="544b0253-05cb-4747-bd92-6426ab122dd1" containerName="main" containerID="cri-o://3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1" gracePeriod=45
Nov 02 18:13:42.686196 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.686141    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:13:42.735004 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.734967    5054 generic.go:356] "Generic (PLEG): container finished" podID="544b0253-05cb-4747-bd92-6426ab122dd1" containerID="3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1" exitCode=0
Nov 02 18:13:42.735152 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.735016    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"
Nov 02 18:13:42.735152 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.735058    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" event={"ID":"544b0253-05cb-4747-bd92-6426ab122dd1","Type":"ContainerDied","Data":"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"}
Nov 02 18:13:42.735152 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.735113    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv" event={"ID":"544b0253-05cb-4747-bd92-6426ab122dd1","Type":"ContainerDied","Data":"c77d35c3bbac0275732d503060a5ae8bedf8d378de9abffcbb7d3ab1e02d3022"}
Nov 02 18:13:42.735152 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.735139    5054 scope.go:122] "RemoveContainer" containerID="3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"
Nov 02 18:13:42.745375 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.745357    5054 scope.go:122] "RemoveContainer" containerID="3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"
Nov 02 18:13:42.745656 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:13:42.745637    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1\": container with ID starting with 3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1 not found: ID does not exist" containerID="3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"
Nov 02 18:13:42.745710 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.745677    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1"} err="failed to get container status \"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1\": rpc error: code = NotFound desc = could not find container \"3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1\": container with ID starting with 3a183dc9da9ea7c3f9f9bda25081f377ba89f39887cc082c4fc4f79910d556e1 not found: ID does not exist"
Nov 02 18:13:42.767616 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767594    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.767690 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767667    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.767739 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767705    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\" (UniqueName: \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.767739 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767732    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.767876 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767752    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\" (UniqueName: \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.767876 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767864    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\") pod \"544b0253-05cb-4747-bd92-6426ab122dd1\" (UID: \"544b0253-05cb-4747-bd92-6426ab122dd1\") "
Nov 02 18:13:42.768036 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767861    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:13:42.768120 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.768046    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:13:42.768120 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.767945    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:13:42.768237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.768216    5054 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-home\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:42.768237 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.768230    5054 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-model-cache\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:42.768318 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.768240    5054 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-tmp-dir\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:42.770045 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.770023    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:13:42.770133 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.770116    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:13:42.770179 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.770155    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5" pod "544b0253-05cb-4747-bd92-6426ab122dd1" (UID: "544b0253-05cb-4747-bd92-6426ab122dd1"). InnerVolumeSpecName "kube-api-access-5p4p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:13:42.868795 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.868749    5054 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544b0253-05cb-4747-bd92-6426ab122dd1-tls-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:42.868795 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.868793    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p4p5\" (UniqueName: \"kubernetes.io/projected/544b0253-05cb-4747-bd92-6426ab122dd1-kube-api-access-5p4p5\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:42.868795 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:42.868804    5054 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544b0253-05cb-4747-bd92-6426ab122dd1-dshm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:43.057360 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:43.057331    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:13:43.061183 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:43.061157    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-a6fb1955-kserve-574bb55b57-t8krv"]
Nov 02 18:13:43.847122 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:43.847089    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:44.644750 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:44.644715    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="544b0253-05cb-4747-bd92-6426ab122dd1" path="/var/lib/kubelet/pods/544b0253-05cb-4747-bd92-6426ab122dd1/volumes"
Nov 02 18:13:45.983487 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:13:45.983412    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:13:47.354948 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:47.354911    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:13:53.589976 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.589938    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"]
Nov 02 18:13:53.590391 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590382    5054 cpu_manager.go:414] "containerMap: removing container" podUID="f8e6144c-4ffb-47f2-b201-7379bd7e4be4" containerName="revoke-keys"
Nov 02 18:13:53.590436 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590393    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8e6144c-4ffb-47f2-b201-7379bd7e4be4" containerName="revoke-keys"
Nov 02 18:13:53.590436 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590410    5054 cpu_manager.go:414] "containerMap: removing container" podUID="544b0253-05cb-4747-bd92-6426ab122dd1" containerName="main"
Nov 02 18:13:53.590436 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590415    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="544b0253-05cb-4747-bd92-6426ab122dd1" containerName="main"
Nov 02 18:13:53.590534 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590479    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8e6144c-4ffb-47f2-b201-7379bd7e4be4" containerName="revoke-keys"
Nov 02 18:13:53.590534 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.590489    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="544b0253-05cb-4747-bd92-6426ab122dd1" containerName="main"
Nov 02 18:13:53.593715 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.593699    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.599121 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.599089    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 18:13:53.599266 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.599146    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:13:53.599471 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.599450    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:13:53.599596 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.599494    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pqf2d\""
Nov 02 18:13:53.601569 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.601464    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"]
Nov 02 18:13:53.687218 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.687172    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.687218 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.687232    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.687467 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.687342    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7mvv\" (UniqueName: \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.788752 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.788696    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.788752 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.788758    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.789069 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.788795    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7mvv\" (UniqueName: \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.789519 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.789491    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.791227 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.791204    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.797148 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.797124    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7mvv\" (UniqueName: \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\") pod \"maas-api-revoke-sub-4aacb06d-qzgdb\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:53.908780 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:53.908693    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:54.186145 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:54.186118    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"]
Nov 02 18:13:54.187559 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:13:54.187532    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf731c235_8f8f_49b1_8076_68cc883818db.slice/crio-74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc WatchSource:0}: Error finding container 74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc: Status 404 returned error can't find the container with id 74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc
Nov 02 18:13:54.894314 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:54.894221    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb" event={"ID":"f731c235-8f8f-49b1-8076-68cc883818db","Type":"ContainerStarted","Data":"68762a42c8ea1fbabae2b355707ff96b3e154219f9f2f145d1ace1bb31af5573"}
Nov 02 18:13:54.894314 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:54.894280    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb" event={"ID":"f731c235-8f8f-49b1-8076-68cc883818db","Type":"ContainerStarted","Data":"74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc"}
Nov 02 18:13:54.912076 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:54.912027    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb" podStartSLOduration=1.912009972 podStartE2EDuration="1.912009972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:13:54.911353328 +0000 UTC m=+2038.420115394" watchObservedRunningTime="2026-11-02 18:13:54.912009972 +0000 UTC m=+2038.420772039"
Nov 02 18:13:55.901759 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:55.901723    5054 generic.go:356] "Generic (PLEG): container finished" podID="f731c235-8f8f-49b1-8076-68cc883818db" containerID="68762a42c8ea1fbabae2b355707ff96b3e154219f9f2f145d1ace1bb31af5573" exitCode=0
Nov 02 18:13:55.902242 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:55.901805    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb" event={"ID":"f731c235-8f8f-49b1-8076-68cc883818db","Type":"ContainerDied","Data":"68762a42c8ea1fbabae2b355707ff96b3e154219f9f2f145d1ace1bb31af5573"}
Nov 02 18:13:57.053216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.053191    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:57.221988 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.221955    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\" (UniqueName: \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\") pod \"f731c235-8f8f-49b1-8076-68cc883818db\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") "
Nov 02 18:13:57.222207 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.222034    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\") pod \"f731c235-8f8f-49b1-8076-68cc883818db\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") "
Nov 02 18:13:57.222207 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.222151    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\") pod \"f731c235-8f8f-49b1-8076-68cc883818db\" (UID: \"f731c235-8f8f-49b1-8076-68cc883818db\") "
Nov 02 18:13:57.222530 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.222507    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca" pod "f731c235-8f8f-49b1-8076-68cc883818db" (UID: "f731c235-8f8f-49b1-8076-68cc883818db"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:13:57.224120 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.224091    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv" pod "f731c235-8f8f-49b1-8076-68cc883818db" (UID: "f731c235-8f8f-49b1-8076-68cc883818db"). InnerVolumeSpecName "kube-api-access-j7mvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:13:57.224226 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.224182    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca" pod "f731c235-8f8f-49b1-8076-68cc883818db" (UID: "f731c235-8f8f-49b1-8076-68cc883818db"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:13:57.323348 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.323315    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7mvv\" (UniqueName: \"kubernetes.io/projected/f731c235-8f8f-49b1-8076-68cc883818db-kube-api-access-j7mvv\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:57.323348 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.323343    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-xks-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:57.323348 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.323353    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f731c235-8f8f-49b1-8076-68cc883818db-maas-api-openshift-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:13:57.914739 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.914701    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"
Nov 02 18:13:57.914934 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.914748    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb" event={"ID":"f731c235-8f8f-49b1-8076-68cc883818db","Type":"ContainerDied","Data":"74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc"}
Nov 02 18:13:57.914934 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:13:57.914794    5054 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74cc65ae9ec9c144c49563d22ddbf81dcd4a0da7b97d6a6221f69bade0498afc"
Nov 02 18:14:04.428241 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:04.428204    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:14:05.718553 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.718507    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:05.719274 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.719252    5054 cpu_manager.go:414] "containerMap: removing container" podUID="f731c235-8f8f-49b1-8076-68cc883818db" containerName="revoke-keys"
Nov 02 18:14:05.719348 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.719278    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f731c235-8f8f-49b1-8076-68cc883818db" containerName="revoke-keys"
Nov 02 18:14:05.719407 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.719397    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="f731c235-8f8f-49b1-8076-68cc883818db" containerName="revoke-keys"
Nov 02 18:14:05.724762 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.724736    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.733455 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.733415    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-szhm5\""
Nov 02 18:14:05.734193 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.734172    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 18:14:05.734406 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.734372    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 18:14:05.734609 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.734594    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:05.736101 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.736080    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 18:14:05.736590 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.736307    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 18:14:05.739187 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.739166    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"]
Nov 02 18:14:05.743509 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.743487    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.752905 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.752883    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"]
Nov 02 18:14:05.812778 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.812743    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9635ae82-8112-471c-b269-786574d553b2-openshift-service-ca\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.812778 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.812782    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stf5\" (UniqueName: \"kubernetes.io/projected/9635ae82-8112-471c-b269-786574d553b2-kube-api-access-8stf5\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.813035 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.812821    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.813035 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.812900    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-maas-api-tls\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.813150 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.813048    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6nc\" (UniqueName: \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.813150 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.813082    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.813150 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.813111    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-metrics-certs\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.813309 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.813204    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.914139 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914102    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9635ae82-8112-471c-b269-786574d553b2-openshift-service-ca\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.914139 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914143    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stf5\" (UniqueName: \"kubernetes.io/projected/9635ae82-8112-471c-b269-786574d553b2-kube-api-access-8stf5\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914169    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914188    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-maas-api-tls\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914241    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6nc\" (UniqueName: \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914284    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914315    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-metrics-certs\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.914422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.914359    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.915115 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.915083    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9635ae82-8112-471c-b269-786574d553b2-openshift-service-ca\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.915267 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.915232    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.917000 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.916979    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.917100 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.917084    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:05.917449 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.917420    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-metrics-certs\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.917773 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.917755    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9635ae82-8112-471c-b269-786574d553b2-maas-api-tls\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.922221 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.922201    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stf5\" (UniqueName: \"kubernetes.io/projected/9635ae82-8112-471c-b269-786574d553b2-kube-api-access-8stf5\") pod \"maas-api-5fd8dffdf6-4j9pl\" (UID: \"9635ae82-8112-471c-b269-786574d553b2\") " pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:05.922363 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:05.922342    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6nc\" (UniqueName: \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\") pod \"maas-api-66989884-8cp6w\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") " pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:06.044642 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.044561    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:06.063307 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.063271    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:06.331135 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:14:06.331097    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22f80bf_cc73_45bb_9d64_5f8c7ae0f99e.slice/crio-4662b33e9a51824a05c5780638290f3084d3638f70c2ef4a13c0d02c42a69b6b WatchSource:0}: Error finding container 4662b33e9a51824a05c5780638290f3084d3638f70c2ef4a13c0d02c42a69b6b: Status 404 returned error can't find the container with id 4662b33e9a51824a05c5780638290f3084d3638f70c2ef4a13c0d02c42a69b6b
Nov 02 18:14:06.331264 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.331212    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:06.332799 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.332781    5054 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 18:14:06.364620 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.364596    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"]
Nov 02 18:14:06.365228 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:14:06.365205    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9635ae82_8112_471c_b269_786574d553b2.slice/crio-70861d2709aa18adff9040f8142216ceea2b79be491a7267a137d50f213260a8 WatchSource:0}: Error finding container 70861d2709aa18adff9040f8142216ceea2b79be491a7267a137d50f213260a8: Status 404 returned error can't find the container with id 70861d2709aa18adff9040f8142216ceea2b79be491a7267a137d50f213260a8
Nov 02 18:14:06.968741 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.968702    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" event={"ID":"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e","Type":"ContainerStarted","Data":"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"}
Nov 02 18:14:06.969207 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.968771    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:06.969207 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.968793    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" event={"ID":"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e","Type":"ContainerStarted","Data":"4662b33e9a51824a05c5780638290f3084d3638f70c2ef4a13c0d02c42a69b6b"}
Nov 02 18:14:06.970396 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.970365    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl" event={"ID":"9635ae82-8112-471c-b269-786574d553b2","Type":"ContainerStarted","Data":"e202d2d9ab3d896c3831a144ba38fd790258983bb888320a018f67bad36254b4"}
Nov 02 18:14:06.970540 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.970419    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl" event={"ID":"9635ae82-8112-471c-b269-786574d553b2","Type":"ContainerStarted","Data":"70861d2709aa18adff9040f8142216ceea2b79be491a7267a137d50f213260a8"}
Nov 02 18:14:06.970780 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.970752    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:06.986501 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:06.986446    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" podStartSLOduration=1.471054296 podStartE2EDuration="1.986429993s" totalImagesPullingTime="515.375697ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:14:06.985883482 +0000 UTC m=+2050.494645550" watchObservedRunningTime="2026-11-02 18:14:06.986429993 +0000 UTC m=+2050.495192061"
Nov 02 18:14:07.003793 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:07.003733    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl" podStartSLOduration=1.5169299760000001 podStartE2EDuration="2.003716771s" totalImagesPullingTime="486.786795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:14:07.002764656 +0000 UTC m=+2050.511526723" watchObservedRunningTime="2026-11-02 18:14:07.003716771 +0000 UTC m=+2050.512478835"
Nov 02 18:14:12.981706 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:12.981672    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:12.984200 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:12.982055    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fd8dffdf6-4j9pl"
Nov 02 18:14:13.048187 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.048153    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:13.048378 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.048323    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" podUID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" containerName="maas-api" containerID="cri-o://8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4" gracePeriod=30
Nov 02 18:14:13.361078 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.361037    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:13.390969 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.390940    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\" (UniqueName: \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\") pod \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") "
Nov 02 18:14:13.391131 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.390983    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\") pod \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") "
Nov 02 18:14:13.391131 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.391062    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\") pod \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") "
Nov 02 18:14:13.391219 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.391207    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\") pod \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\" (UID: \"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e\") "
Nov 02 18:14:13.391413 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.391375    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca" pod "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" (UID: "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:14:13.391725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.391643    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:13.393289 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.393260    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc" pod "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" (UID: "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e"). InnerVolumeSpecName "kube-api-access-cp6nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:14:13.398535 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.398510    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs" pod "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" (UID: "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:14:13.400102 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.400077    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls" pod "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" (UID: "c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:14:13.493017 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.492982    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:13.493017 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.493011    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp6nc\" (UniqueName: \"kubernetes.io/projected/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-kube-api-access-cp6nc\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:13.493017 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:13.493023    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:14.011788 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.011755    5054 generic.go:356] "Generic (PLEG): container finished" podID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" containerID="8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4" exitCode=0
Nov 02 18:14:14.012302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.011818    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w"
Nov 02 18:14:14.012302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.011826    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" event={"ID":"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e","Type":"ContainerDied","Data":"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"}
Nov 02 18:14:14.012302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.011907    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66989884-8cp6w" event={"ID":"c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e","Type":"ContainerDied","Data":"4662b33e9a51824a05c5780638290f3084d3638f70c2ef4a13c0d02c42a69b6b"}
Nov 02 18:14:14.012302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.011937    5054 scope.go:122] "RemoveContainer" containerID="8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"
Nov 02 18:14:14.022403 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.022385    5054 scope.go:122] "RemoveContainer" containerID="8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"
Nov 02 18:14:14.022668 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:14:14.022650    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4\": container with ID starting with 8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4 not found: ID does not exist" containerID="8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"
Nov 02 18:14:14.022751 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.022682    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4"} err="failed to get container status \"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4\": rpc error: code = NotFound desc = could not find container \"8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4\": container with ID starting with 8e39122b5dbc5133d5412e17a45b8003e4ccbdf82aa54c9ee5d380b625ca68d4 not found: ID does not exist"
Nov 02 18:14:14.037010 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.036982    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:14.039664 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.039642    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-66989884-8cp6w"]
Nov 02 18:14:14.617701 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:14.617663    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" path="/var/lib/kubelet/pods/c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e/volumes"
Nov 02 18:14:15.836611 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:14:15.836575    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:14:17.029556 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.029514    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:17.030171 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.030148    5054 cpu_manager.go:414] "containerMap: removing container" podUID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" containerName="maas-api"
Nov 02 18:14:17.030338 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.030313    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" containerName="maas-api"
Nov 02 18:14:17.030499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.030480    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="c22f80bf-cc73-45bb-9d64-5f8c7ae0f99e" containerName="maas-api"
Nov 02 18:14:17.042427 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.042356    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.049540 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.049514    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-082e58b0-serving-cert\""
Nov 02 18:14:17.050543 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.050514    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:17.130354 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.130323    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.130550 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.130361    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkfzn\" (UniqueName: \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.130550 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.130495    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.130684 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.130557    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.232074 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.232038    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.232271 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.232096    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.232271 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.232165    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.232271 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.232207    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkfzn\" (UniqueName: \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.232880 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.232833    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.234758 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.234731    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.234901 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.234731    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.241491 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.241468    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkfzn\" (UniqueName: \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\") pod \"maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.362569 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.362495    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:17.640895 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:17.640862    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:17.642627 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:14:17.642597    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd806f613_42f1_4113_ac26_c16af52f1127.slice/crio-06cf8de6fc8d2512876023deac2d215645d5ad7dcb8dbbdc1682ba62f85a9bc8 WatchSource:0}: Error finding container 06cf8de6fc8d2512876023deac2d215645d5ad7dcb8dbbdc1682ba62f85a9bc8: Status 404 returned error can't find the container with id 06cf8de6fc8d2512876023deac2d215645d5ad7dcb8dbbdc1682ba62f85a9bc8
Nov 02 18:14:18.048344 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:18.048260    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" event={"ID":"d806f613-42f1-4113-ac26-c16af52f1127","Type":"ContainerStarted","Data":"06cf8de6fc8d2512876023deac2d215645d5ad7dcb8dbbdc1682ba62f85a9bc8"}
Nov 02 18:14:19.055792 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:19.055756    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" event={"ID":"d806f613-42f1-4113-ac26-c16af52f1127","Type":"ContainerStarted","Data":"88d493bb2f6da1b69cbe25e3ec6ba1816ee32dff9b178665a920c2a30382522f"}
Nov 02 18:14:19.056227 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:19.055816    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:19.075416 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:19.075365    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" podStartSLOduration=1.595538016 podStartE2EDuration="2.075350035s" totalImagesPullingTime="479.812019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:14:19.073231022 +0000 UTC m=+2062.581993090" watchObservedRunningTime="2026-11-02 18:14:19.075350035 +0000 UTC m=+2062.584112107"
Nov 02 18:14:19.928860 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:19.927951    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:14:25.068894 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:25.068864    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:45.835473 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:14:45.835430    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:14:53.082684 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.082643    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:53.083362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.082896    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" podUID="d806f613-42f1-4113-ac26-c16af52f1127" containerName="maas-api" containerID="cri-o://88d493bb2f6da1b69cbe25e3ec6ba1816ee32dff9b178665a920c2a30382522f" gracePeriod=30
Nov 02 18:14:53.261418 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.261374    5054 generic.go:356] "Generic (PLEG): container finished" podID="d806f613-42f1-4113-ac26-c16af52f1127" containerID="88d493bb2f6da1b69cbe25e3ec6ba1816ee32dff9b178665a920c2a30382522f" exitCode=0
Nov 02 18:14:53.261558 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.261462    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" event={"ID":"d806f613-42f1-4113-ac26-c16af52f1127","Type":"ContainerDied","Data":"88d493bb2f6da1b69cbe25e3ec6ba1816ee32dff9b178665a920c2a30382522f"}
Nov 02 18:14:53.370999 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.370970    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:53.411737 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.411704    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\") pod \"d806f613-42f1-4113-ac26-c16af52f1127\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") "
Nov 02 18:14:53.411967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.411749    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\" (UniqueName: \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\") pod \"d806f613-42f1-4113-ac26-c16af52f1127\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") "
Nov 02 18:14:53.411967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.411769    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\") pod \"d806f613-42f1-4113-ac26-c16af52f1127\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") "
Nov 02 18:14:53.411967 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.411884    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\") pod \"d806f613-42f1-4113-ac26-c16af52f1127\" (UID: \"d806f613-42f1-4113-ac26-c16af52f1127\") "
Nov 02 18:14:53.412176 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.412150    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca" pod "d806f613-42f1-4113-ac26-c16af52f1127" (UID: "d806f613-42f1-4113-ac26-c16af52f1127"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:14:53.414245 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.414214    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs" pod "d806f613-42f1-4113-ac26-c16af52f1127" (UID: "d806f613-42f1-4113-ac26-c16af52f1127"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:14:53.414533 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.414509    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls" pod "d806f613-42f1-4113-ac26-c16af52f1127" (UID: "d806f613-42f1-4113-ac26-c16af52f1127"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:14:53.414631 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.414565    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn" pod "d806f613-42f1-4113-ac26-c16af52f1127" (UID: "d806f613-42f1-4113-ac26-c16af52f1127"). InnerVolumeSpecName "kube-api-access-mkfzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:14:53.513203 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.513162    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d806f613-42f1-4113-ac26-c16af52f1127-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:53.513203 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.513198    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkfzn\" (UniqueName: \"kubernetes.io/projected/d806f613-42f1-4113-ac26-c16af52f1127-kube-api-access-mkfzn\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:53.513203 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.513212    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:53.513450 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:53.513225    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d806f613-42f1-4113-ac26-c16af52f1127-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:14:54.268709 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.268682    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"
Nov 02 18:14:54.268709 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.268704    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl" event={"ID":"d806f613-42f1-4113-ac26-c16af52f1127","Type":"ContainerDied","Data":"06cf8de6fc8d2512876023deac2d215645d5ad7dcb8dbbdc1682ba62f85a9bc8"}
Nov 02 18:14:54.269285 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.268763    5054 scope.go:122] "RemoveContainer" containerID="88d493bb2f6da1b69cbe25e3ec6ba1816ee32dff9b178665a920c2a30382522f"
Nov 02 18:14:54.292937 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.292908    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:54.298342 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.298318    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-082e58b0-5cddc78c47-hgfvl"]
Nov 02 18:14:54.617773 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.617689    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d806f613-42f1-4113-ac26-c16af52f1127" path="/var/lib/kubelet/pods/d806f613-42f1-4113-ac26-c16af52f1127/volumes"
Nov 02 18:14:54.661902 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:54.661866    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:14:56.962117 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:56.962088    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:14:56.965395 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:56.965371    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:14:56.971126 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:56.971103    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:14:56.973995 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:14:56.973977    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:15:00.140468 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.140431    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:15:00.141018 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.140997    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d806f613-42f1-4113-ac26-c16af52f1127" containerName="maas-api"
Nov 02 18:15:00.141098 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.141019    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d806f613-42f1-4113-ac26-c16af52f1127" containerName="maas-api"
Nov 02 18:15:00.141223 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.141204    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="d806f613-42f1-4113-ac26-c16af52f1127" containerName="maas-api"
Nov 02 18:15:00.146111 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.146089    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.158441 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.158412    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:15:00.175752 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.175721    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-authcfg-http-5d4d8d-openshift-default-dockercfg-2qh54\""
Nov 02 18:15:00.189770 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.189742    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.189991 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.189793    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.189991 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.189949    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.189992    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56j6\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.190036    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.190062    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.190112    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.190154    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.190209 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.190196    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291149 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291110    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291576 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291553    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291594    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56j6\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291638    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291662    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291892 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291712    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291892 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291758    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.291892 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291805    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.292096 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.291933    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.293083 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.293031    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.293561 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.293532    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.293791 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.293768    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.294250 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.294226    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.296343 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.296319    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.297720 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.297696    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.306022 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.305974    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.312188 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.312157    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56j6\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.314605 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.314582    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\") pod \"e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") " pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.463988 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.463943    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:00.755814 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.755782    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:15:00.757129 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:15:00.757101    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6643c43_2304_4529_af73_afc62bc27836.slice/crio-550148af0aeea0a0be4be65db3d940f526aabde6890bd4fb53da6617254c413c WatchSource:0}: Error finding container 550148af0aeea0a0be4be65db3d940f526aabde6890bd4fb53da6617254c413c: Status 404 returned error can't find the container with id 550148af0aeea0a0be4be65db3d940f526aabde6890bd4fb53da6617254c413c
Nov 02 18:15:00.760030 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.759991    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:00.760114 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.760064    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:00.760114 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:00.760096    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:01.330735 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:01.330686    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerStarted","Data":"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"}
Nov 02 18:15:01.331381 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:01.330795    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerStarted","Data":"550148af0aeea0a0be4be65db3d940f526aabde6890bd4fb53da6617254c413c"}
Nov 02 18:15:01.356756 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:01.356698    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podStartSLOduration=1.356683239 podStartE2EDuration="1.356683239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:15:01.354690425 +0000 UTC m=+2104.863452483" watchObservedRunningTime="2026-11-02 18:15:01.356683239 +0000 UTC m=+2104.865445302"
Nov 02 18:15:01.466308 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:01.465256    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:01.484612 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:01.484178    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:02.337502 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:02.337468    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:02.338779 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:02.338754    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:04.733031 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.732999    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:15:04.737038 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.737015    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.744945 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.744907    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-5d4d8d-serving-cert\""
Nov 02 18:15:04.755258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.755232    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:15:04.839966 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.839934    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.840108 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.839973    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.840108 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.839991    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.840184 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.840140    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwvgm\" (UniqueName: \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.941282 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.941244    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwvgm\" (UniqueName: \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.941434 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.941367    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.941434 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.941400    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.941434 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.941425    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.941579 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:15:04.941531    5054 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-serving-cert: secret "maas-api-e2e-authcfg-http-5d4d8d-serving-cert" not found
Nov 02 18:15:04.941669 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:15:04.941655    5054 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls podName:29bd5f86-c5f6-4d00-959b-aa352abc3119 nodeName:}" failed. No retries permitted until 2026-11-02 18:15:05.441627139 +0000 UTC m=+2108.950389204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls") pod "maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" (UID: "29bd5f86-c5f6-4d00-959b-aa352abc3119") : secret "maas-api-e2e-authcfg-http-5d4d8d-serving-cert" not found
Nov 02 18:15:04.942224 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.942197    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.944086 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.944062    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:04.950113 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:04.950090    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwvgm\" (UniqueName: \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:05.447659 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:05.447602    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:05.450433 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:05.450403    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:05.661324 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:05.661292    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:05.938683 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:05.938658    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:15:05.940485 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:15:05.940452    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bd5f86_c5f6_4d00_959b_aa352abc3119.slice/crio-cded7503617e9b04ad51532440c70d3831656cafafef30b07a6ac49cf504f170 WatchSource:0}: Error finding container cded7503617e9b04ad51532440c70d3831656cafafef30b07a6ac49cf504f170: Status 404 returned error can't find the container with id cded7503617e9b04ad51532440c70d3831656cafafef30b07a6ac49cf504f170
Nov 02 18:15:06.374730 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:06.374697    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" event={"ID":"29bd5f86-c5f6-4d00-959b-aa352abc3119","Type":"ContainerStarted","Data":"cded7503617e9b04ad51532440c70d3831656cafafef30b07a6ac49cf504f170"}
Nov 02 18:15:06.959929 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:06.959888    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:15:07.383038 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:07.382888    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" event={"ID":"29bd5f86-c5f6-4d00-959b-aa352abc3119","Type":"ContainerStarted","Data":"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"}
Nov 02 18:15:07.383038 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:07.382984    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:07.407763 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:07.407706    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" podStartSLOduration=3.016757201 podStartE2EDuration="3.407691588s" totalImagesPullingTime="390.934387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 18:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:15:07.403847847 +0000 UTC m=+2110.912609905" watchObservedRunningTime="2026-11-02 18:15:07.407691588 +0000 UTC m=+2110.916453654"
Nov 02 18:15:13.405944 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:13.405905    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:15:15.835368 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:15:15.835326    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:15:17.338715 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.338679    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:17.339221 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.338739    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:17.457694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.457663    5054 generic.go:356] "Generic (PLEG): container finished" podID="d6643c43-2304-4529-af73-afc62bc27836" containerID="9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db" exitCode=0
Nov 02 18:15:17.457878 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.457742    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerDied","Data":"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"}
Nov 02 18:15:17.458200 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.458182    5054 scope.go:122] "RemoveContainer" containerID="9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"
Nov 02 18:15:17.459540 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.459511    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:17.459600 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.459580    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:17.459637 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:17.459613    5054 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 18:15:18.465227 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:18.465195    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerStarted","Data":"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"}
Nov 02 18:15:19.464326 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:19.464287    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:19.464558 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:19.464527    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:19.464633 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:19.464584    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:20.465072 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:20.465027    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:20.465474 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:20.465097    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:21.465273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:21.465238    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:21.465691 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:21.465292    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:22.464404 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:22.464368    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:22.464588 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:22.464423    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:23.465271 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:23.465234    5054 patch_prober.go:29] interesting pod/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Nov 02 18:15:23.465736 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:23.465308    5054 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Nov 02 18:15:24.469218 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:24.469187    5054 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:24.469725 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:24.469577    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:24.470426 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:24.470406    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:15:45.836487 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:15:45.836448    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:15:46.021368 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:46.021334    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"]
Nov 02 18:15:46.023700 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:46.023679    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-wrfbw"]
Nov 02 18:15:46.616302 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:15:46.616269    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8634a34a-c46e-4c2b-b326-da7d498c11b6" path="/var/lib/kubelet/pods/8634a34a-c46e-4c2b-b326-da7d498c11b6/volumes"
Nov 02 18:16:05.024815 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:05.024769    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"]
Nov 02 18:16:05.027497 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:05.027472    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7mcrq"]
Nov 02 18:16:06.617927 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:06.617893    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f109c0a-92b8-4c4b-8c5a-a9ef457174ff" path="/var/lib/kubelet/pods/0f109c0a-92b8-4c4b-8c5a-a9ef457174ff/volumes"
Nov 02 18:16:15.834952 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:16:15.834912    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:16:45.835545 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:16:45.835449    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:16:54.210270 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.206957    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:16:54.210270 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.207212    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" podUID="29bd5f86-c5f6-4d00-959b-aa352abc3119" containerName="maas-api" containerID="cri-o://c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723" gracePeriod=30
Nov 02 18:16:54.472525 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.472459    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:16:54.564159 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.564126    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") pod \"29bd5f86-c5f6-4d00-959b-aa352abc3119\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") "
Nov 02 18:16:54.564362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.564190    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\") pod \"29bd5f86-c5f6-4d00-959b-aa352abc3119\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") "
Nov 02 18:16:54.564362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.564245    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\" (UniqueName: \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\") pod \"29bd5f86-c5f6-4d00-959b-aa352abc3119\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") "
Nov 02 18:16:54.564362 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.564292    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\") pod \"29bd5f86-c5f6-4d00-959b-aa352abc3119\" (UID: \"29bd5f86-c5f6-4d00-959b-aa352abc3119\") "
Nov 02 18:16:54.564683 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.564636    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca" pod "29bd5f86-c5f6-4d00-959b-aa352abc3119" (UID: "29bd5f86-c5f6-4d00-959b-aa352abc3119"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:16:54.566462 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.566434    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls" pod "29bd5f86-c5f6-4d00-959b-aa352abc3119" (UID: "29bd5f86-c5f6-4d00-959b-aa352abc3119"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:16:54.566566 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.566471    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs" pod "29bd5f86-c5f6-4d00-959b-aa352abc3119" (UID: "29bd5f86-c5f6-4d00-959b-aa352abc3119"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 18:16:54.566566 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.566534    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm" pod "29bd5f86-c5f6-4d00-959b-aa352abc3119" (UID: "29bd5f86-c5f6-4d00-959b-aa352abc3119"). InnerVolumeSpecName "kube-api-access-hwvgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:16:54.665475 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.665441    5054 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-maas-api-tls\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:16:54.665475 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.665470    5054 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bd5f86-c5f6-4d00-959b-aa352abc3119-openshift-service-ca\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:16:54.665669 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.665484    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwvgm\" (UniqueName: \"kubernetes.io/projected/29bd5f86-c5f6-4d00-959b-aa352abc3119-kube-api-access-hwvgm\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:16:54.665669 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:54.665497    5054 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29bd5f86-c5f6-4d00-959b-aa352abc3119-metrics-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:16:55.074714 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.074678    5054 generic.go:356] "Generic (PLEG): container finished" podID="29bd5f86-c5f6-4d00-959b-aa352abc3119" containerID="c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723" exitCode=0
Nov 02 18:16:55.074714 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.074717    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" event={"ID":"29bd5f86-c5f6-4d00-959b-aa352abc3119","Type":"ContainerDied","Data":"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"}
Nov 02 18:16:55.075011 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.074724    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"
Nov 02 18:16:55.075011 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.074767    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2" event={"ID":"29bd5f86-c5f6-4d00-959b-aa352abc3119","Type":"ContainerDied","Data":"cded7503617e9b04ad51532440c70d3831656cafafef30b07a6ac49cf504f170"}
Nov 02 18:16:55.075011 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.074790    5054 scope.go:122] "RemoveContainer" containerID="c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"
Nov 02 18:16:55.084654 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.084634    5054 scope.go:122] "RemoveContainer" containerID="c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"
Nov 02 18:16:55.084975 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:16:55.084952    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723\": container with ID starting with c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723 not found: ID does not exist" containerID="c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"
Nov 02 18:16:55.085049 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.084993    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723"} err="failed to get container status \"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723\": rpc error: code = NotFound desc = could not find container \"c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723\": container with ID starting with c1cc63655cdd2ffc7913d5ceabf3fb1c31a76ee86b453a6926eaa50a8267e723 not found: ID does not exist"
Nov 02 18:16:55.093750 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.093725    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:16:55.099243 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.099219    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-5d4d8d-dd8444b7c-drxr2"]
Nov 02 18:16:55.937521 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:55.937487    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:16:56.617149 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:56.617116    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29bd5f86-c5f6-4d00-959b-aa352abc3119" path="/var/lib/kubelet/pods/29bd5f86-c5f6-4d00-959b-aa352abc3119/volumes"
Nov 02 18:16:58.007978 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:16:58.007937    5054 scope.go:122] "RemoveContainer" containerID="5e79edf09f4f1a1e1dacd6b59d4880c5fed3b3bb685a554d384cacc80e8d4c41"
Nov 02 18:17:01.095113 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:01.095078    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:17:01.095712 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:01.095289    5054 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy" containerID="cri-o://b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51" gracePeriod=30
Nov 02 18:17:03.077508 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:03.077475    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:17:06.573264 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.573238    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:17:06.752633 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752540    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752633 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752602    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752903 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752679    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752903 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752731    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752903 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752777    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752903 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752806    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.752903 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752901    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.753190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752911    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:17:06.753190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752970    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.753190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.752997    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:17:06.753190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753019    5054 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\") pod \"d6643c43-2304-4529-af73-afc62bc27836\" (UID: \"d6643c43-2304-4529-af73-afc62bc27836\") "
Nov 02 18:17:06.753403 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753205    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 18:17:06.753403 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753226    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:17:06.753499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753411    5054 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-data\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.753499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753431    5054 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-credential-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.753499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753444    5054 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-certs\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.753499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753458    5054 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6643c43-2304-4529-af73-afc62bc27836-istiod-ca-cert\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.753499 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.753481    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:17:06.755647 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.755613    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:17:06.755751 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.755665    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 18:17:06.755751 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.755677    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 18:17:06.755751 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.755679    5054 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6" pod "d6643c43-2304-4529-af73-afc62bc27836" (UID: "d6643c43-2304-4529-af73-afc62bc27836"). InnerVolumeSpecName "kube-api-access-n56j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 18:17:06.854118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.854083    5054 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n56j6\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-kube-api-access-n56j6\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.854118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.854112    5054 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-istio-envoy\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.854118 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.854122    5054 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6643c43-2304-4529-af73-afc62bc27836-workload-socket\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.854339 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.854132    5054 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6643c43-2304-4529-af73-afc62bc27836-istio-token\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:06.854339 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:06.854141    5054 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6643c43-2304-4529-af73-afc62bc27836-istio-podinfo\") on node \"ip-10-0-132-5.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 18:17:07.214902 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.214863    5054 generic.go:356] "Generic (PLEG): container finished" podID="d6643c43-2304-4529-af73-afc62bc27836" containerID="b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51" exitCode=0
Nov 02 18:17:07.215087 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.214918    5054 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"
Nov 02 18:17:07.215087 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.214926    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerDied","Data":"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"}
Nov 02 18:17:07.215087 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.214988    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf" event={"ID":"d6643c43-2304-4529-af73-afc62bc27836","Type":"ContainerDied","Data":"550148af0aeea0a0be4be65db3d940f526aabde6890bd4fb53da6617254c413c"}
Nov 02 18:17:07.215087 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.215013    5054 scope.go:122] "RemoveContainer" containerID="b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"
Nov 02 18:17:07.225464 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.225448    5054 scope.go:122] "RemoveContainer" containerID="9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"
Nov 02 18:17:07.234057 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.234041    5054 scope.go:122] "RemoveContainer" containerID="b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"
Nov 02 18:17:07.234347 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:17:07.234319    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51\": container with ID starting with b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51 not found: ID does not exist" containerID="b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"
Nov 02 18:17:07.234401 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.234359    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51"} err="failed to get container status \"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51\": rpc error: code = NotFound desc = could not find container \"b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51\": container with ID starting with b84466f1a7fe8e8b01a6b375b2141379b89c4f635cbf14a816cff14e67bf2d51 not found: ID does not exist"
Nov 02 18:17:07.234401 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.234381    5054 scope.go:122] "RemoveContainer" containerID="9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"
Nov 02 18:17:07.234629 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:17:07.234610    5054 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db\": container with ID starting with 9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db not found: ID does not exist" containerID="9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"
Nov 02 18:17:07.234698 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.234637    5054 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db"} err="failed to get container status \"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db\": rpc error: code = NotFound desc = could not find container \"9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db\": container with ID starting with 9814ef1334c498d57c2ec99b706c9a87d660e5dec397f0c1a9c952b87fa005db not found: ID does not exist"
Nov 02 18:17:07.238348 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.238324    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:17:07.242934 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:07.242913    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-authcfg-http-5d4d8d-openshift-default-78567c7977-mcbwf"]
Nov 02 18:17:08.537742 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:08.537703    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:17:08.617216 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:08.617177    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6643c43-2304-4529-af73-afc62bc27836" path="/var/lib/kubelet/pods/d6643c43-2304-4529-af73-afc62bc27836/volumes"
Nov 02 18:17:11.263863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:11.262980    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-2m464 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:17:11.263863 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:11.263060    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2m464" podUID="5804f291-3559-4dda-9b22-ecbf6b2466fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:17:11.267860 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:11.265569    5054 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-qgrwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 18:17:11.267860 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:11.265790    5054 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-qgrwq" podUID="39c672d2-c80e-4b1a-bfa9-70827effa6ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 18:17:15.835946 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:17:15.835903    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:17:23.964483 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:23.964445    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:17:45.836052 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:17:45.836007    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:17:51.030102 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:51.030064    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-9fkg5"]
Nov 02 18:17:51.344143 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:51.344048    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d88f6c9-btwtv_1dfccd22-f886-435b-a52e-b389d887bf0a/authorino/0.log"
Nov 02 18:17:58.042944 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:17:58.042911    5054 scope.go:122] "RemoveContainer" containerID="7ccd9a32583ca04245a8e384613a42f62318ac9da9e151eff5a623cd2eebc0b3"
Nov 02 18:18:13.617978 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:13.617943    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5fd8dffdf6-4j9pl_9635ae82-8112-471c-b269-786574d553b2/maas-api/0.log"
Nov 02 18:18:14.146158 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:14.146128    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-4jgsk_f8e6144c-4ffb-47f2-b201-7379bd7e4be4/revoke-keys/0.log"
Nov 02 18:18:14.318389 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:14.318358    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-452b6d7b-9646w_d4c189bc-3fdf-4b77-a95a-183075637ac5/revoke-keys/0.log"
Nov 02 18:18:14.496476 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:14.496447    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4aacb06d-qzgdb_f731c235-8f8f-49b1-8076-68cc883818db/revoke-keys/0.log"
Nov 02 18:18:15.835503 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:18:15.835460    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:18:16.439099 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:16.439066    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d88f6c9-btwtv_1dfccd22-f886-435b-a52e-b389d887bf0a/authorino/0.log"
Nov 02 18:18:16.655045 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:16.655011    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5fn6f_4652d772-051e-4436-90ea-2ca6f4bf9d6b/manager/0.log"
Nov 02 18:18:16.844320 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:16.844225    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-lx4pv_b6ec3680-571f-49a1-b9ae-15f928e9c9ea/manager/0.log"
Nov 02 18:18:17.210996 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:17.210966    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bqc2p_0260a82c-bf59-43d6-aaa0-de14507341dd/manager/0.log"
Nov 02 18:18:17.420450 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:17.420419    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-9fkg5_efad5adb-0281-4b41-a12e-ab8c8acdc61b/limitador/0.log"
Nov 02 18:18:17.590273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:17.590175    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9t66j_5512a4e8-fecc-49fa-a7c7-b7026fa26b0e/manager/0.log"
Nov 02 18:18:18.326617 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:18.326575    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-lk4lv_009c4f65-25ea-4134-809b-4c5cfdda5ec3/istio-proxy/0.log"
Nov 02 18:18:19.038257 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:19.038225    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/1.log"
Nov 02 18:18:19.219804 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:19.219772    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2m464_5804f291-3559-4dda-9b22-ecbf6b2466fd/istio-proxy/0.log"
Nov 02 18:18:19.724930 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:19.724899    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9qwsm_ed01a4fb-b9a6-412a-9405-e5642d0ce442/istio-proxy/0.log"
Nov 02 18:18:20.393820 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:20.393790    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-qgrwq_39c672d2-c80e-4b1a-bfa9-70827effa6ae/istio-proxy/0.log"
Nov 02 18:18:20.758068 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:20.758038    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp_080990cb-5318-4cba-917d-35766ec311f3/istio-proxy/0.log"
Nov 02 18:18:20.923655 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:20.923621    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z2mhf_c78aa813-24d6-4641-8b94-f1f190f2a381/payload-pre-processing/0.log"
Nov 02 18:18:21.022407 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:21.022324    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"]
Nov 02 18:18:21.024724 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:21.024667    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-9646w"]
Nov 02 18:18:21.098648 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:21.098619    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:18:21.275157 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:21.275084    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86cdd8bc45-6t746_63887114-eb90-460e-a7ed-a4bf04e4fea6/router/0.log"
Nov 02 18:18:21.675523 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:21.675469    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/0.log"
Nov 02 18:18:22.187456 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:22.187429    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc_02cb255a-a7fa-4b5f-9564-4cf7b31f241b/main/0.log"
Nov 02 18:18:22.616768 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:22.616684    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4c189bc-3fdf-4b77-a95a-183075637ac5" path="/var/lib/kubelet/pods/d4c189bc-3fdf-4b77-a95a-183075637ac5/volumes"
Nov 02 18:18:22.708438 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:22.708394    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-659wp_92e662d8-2058-4913-b42e-79039cb95b49/main/0.log"
Nov 02 18:18:23.208193 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:23.208162    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh_125c00ca-770b-45d4-be0b-1cbb03868581/main/0.log"
Nov 02 18:18:23.385678 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:23.385648    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4_0f42dd65-fbba-4ff0-91ee-b306f06d5cad/main/0.log"
Nov 02 18:18:24.199468 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:24.199436    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d88f6c9-btwtv_1dfccd22-f886-435b-a52e-b389d887bf0a/authorino/0.log"
Nov 02 18:18:34.673485 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:34.673458    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5fd8dffdf6-4j9pl_9635ae82-8112-471c-b269-786574d553b2/maas-api/0.log"
Nov 02 18:18:35.196597 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:35.196570    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-4jgsk_f8e6144c-4ffb-47f2-b201-7379bd7e4be4/revoke-keys/0.log"
Nov 02 18:18:35.362092 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:35.362061    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4aacb06d-qzgdb_f731c235-8f8f-49b1-8076-68cc883818db/revoke-keys/0.log"
Nov 02 18:18:36.910907 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:36.910875    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d88f6c9-btwtv_1dfccd22-f886-435b-a52e-b389d887bf0a/authorino/0.log"
Nov 02 18:18:37.019442 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:37.019402    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"]
Nov 02 18:18:37.021985 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:37.021955    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-4jgsk"]
Nov 02 18:18:37.128450 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:37.128404    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5fn6f_4652d772-051e-4436-90ea-2ca6f4bf9d6b/manager/0.log"
Nov 02 18:18:37.309467 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:37.309431    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-lx4pv_b6ec3680-571f-49a1-b9ae-15f928e9c9ea/manager/0.log"
Nov 02 18:18:38.615735 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:38.615692    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8e6144c-4ffb-47f2-b201-7379bd7e4be4" path="/var/lib/kubelet/pods/f8e6144c-4ffb-47f2-b201-7379bd7e4be4/volumes"
Nov 02 18:18:45.835468 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:18:45.835426    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:18:47.676171 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:47.676136    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bqc2p_0260a82c-bf59-43d6-aaa0-de14507341dd/manager/0.log"
Nov 02 18:18:47.916696 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:47.916665    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-9fkg5_efad5adb-0281-4b41-a12e-ab8c8acdc61b/limitador/0.log"
Nov 02 18:18:48.107199 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:48.107117    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9t66j_5512a4e8-fecc-49fa-a7c7-b7026fa26b0e/manager/0.log"
Nov 02 18:18:48.674916 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:48.674882    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-lk4lv_009c4f65-25ea-4134-809b-4c5cfdda5ec3/istio-proxy/0.log"
Nov 02 18:18:49.361732 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:49.361695    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/1.log"
Nov 02 18:18:49.551907 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:49.551876    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2m464_5804f291-3559-4dda-9b22-ecbf6b2466fd/istio-proxy/0.log"
Nov 02 18:18:50.042392 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:50.042363    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9qwsm_ed01a4fb-b9a6-412a-9405-e5642d0ce442/istio-proxy/0.log"
Nov 02 18:18:50.756604 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:50.756575    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-qgrwq_39c672d2-c80e-4b1a-bfa9-70827effa6ae/istio-proxy/0.log"
Nov 02 18:18:57.024465 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:57.024424    5054 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"]
Nov 02 18:18:57.026687 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:57.026664    5054 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4aacb06d-qzgdb"]
Nov 02 18:18:58.623388 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:18:58.623353    5054 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f731c235-8f8f-49b1-8076-68cc883818db" path="/var/lib/kubelet/pods/f731c235-8f8f-49b1-8076-68cc883818db/volumes"
Nov 02 18:19:01.099560 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:01.099526    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp_080990cb-5318-4cba-917d-35766ec311f3/istio-proxy/0.log"
Nov 02 18:19:01.282480 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:01.282429    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z2mhf_c78aa813-24d6-4641-8b94-f1f190f2a381/payload-pre-processing/0.log"
Nov 02 18:19:01.456984 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:01.456952    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:19:01.638423 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:01.638391    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86cdd8bc45-6t746_63887114-eb90-460e-a7ed-a4bf04e4fea6/router/0.log"
Nov 02 18:19:02.148234 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:02.148188    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-xd2tc_02cb255a-a7fa-4b5f-9564-4cf7b31f241b/main/0.log"
Nov 02 18:19:02.631626 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:02.631593    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-659wp_92e662d8-2058-4913-b42e-79039cb95b49/main/0.log"
Nov 02 18:19:03.168742 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:03.168715    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9w6rh_125c00ca-770b-45d4-be0b-1cbb03868581/main/0.log"
Nov 02 18:19:03.346202 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:03.346169    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-wtqk4_0f42dd65-fbba-4ff0-91ee-b306f06d5cad/main/0.log"
Nov 02 18:19:15.835609 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:19:15.835567    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:19:45.835742 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:19:45.835663    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:19:50.375969 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:50.375937    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:19:50.539757 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:50.539727    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:19:57.000354 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:57.000331    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:19:57.003136 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:57.003114    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:19:57.011373 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:57.011354    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:19:57.014164 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:57.014147    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mpwgj_b17ad10e-ee15-4ce8-861e-4e9ab8f8f02d/ovn-acl-logging/0.log"
Nov 02 18:19:58.077380 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:58.077347    5054 scope.go:122] "RemoveContainer" containerID="82b3315ba2fd6c001dc69445497e2358ee0e780f561db547efe2e52f8ee11c6b"
Nov 02 18:19:58.086641 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:58.086624    5054 scope.go:122] "RemoveContainer" containerID="82551d3a88fba9bb65d7181f3aa63cbe9995b791e0523b76c93fa3613fa0a51e"
Nov 02 18:19:58.094788 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:19:58.094767    5054 scope.go:122] "RemoveContainer" containerID="68762a42c8ea1fbabae2b355707ff96b3e154219f9f2f145d1ace1bb31af5573"
Nov 02 18:20:15.835495 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:20:15.835450    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:20:34.997388 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:34.997355    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:20:35.173742 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:35.173717    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:20:38.582856 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.582814    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fmrts_d62c4231-ec62-436e-8eef-96bda48364c7/global-pull-secret-syncer/0.log"
Nov 02 18:20:38.770170 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.770139    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-d8jlp_dc5bbef7-9279-44d0-b1fb-0dd242c10b88/connection-checker/0.log"
Nov 02 18:20:38.795609 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.795583    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-t5xrk_e2978e7a-385f-4edb-8bac-e691bb7e8c69/connection-checker/0.log"
Nov 02 18:20:38.824119 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.824092    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-v9dk7_d125ccb7-dd74-43c4-8bdf-970121de6423/connection-checker/0.log"
Nov 02 18:20:38.905678 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.905609    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9h65q_e2e9f10a-d472-47de-bb6d-fe29d2285945/konnectivity-agent/0.log"
Nov 02 18:20:38.964076 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:38.964046    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-5.us-east-2.compute.internal_f23d73ef12b6a83fae531e9ed10d8052/haproxy/0.log"
Nov 02 18:20:45.717374 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.717335    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d88f6c9-btwtv_1dfccd22-f886-435b-a52e-b389d887bf0a/authorino/0.log"
Nov 02 18:20:45.761048 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.761017    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5fn6f_4652d772-051e-4436-90ea-2ca6f4bf9d6b/manager/0.log"
Nov 02 18:20:45.797517 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.797489    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-lx4pv_b6ec3680-571f-49a1-b9ae-15f928e9c9ea/manager/0.log"
Nov 02 18:20:45.836217 ip-10-0-132-5 kubenswrapper[5054]: E1102 18:20:45.836179    5054 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jb2qt" containerName="extractor"
Nov 02 18:20:45.880345 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.880312    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bqc2p_0260a82c-bf59-43d6-aaa0-de14507341dd/manager/0.log"
Nov 02 18:20:45.911823 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.911792    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-9fkg5_efad5adb-0281-4b41-a12e-ab8c8acdc61b/limitador/0.log"
Nov 02 18:20:45.975501 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:45.975410    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9t66j_5512a4e8-fecc-49fa-a7c7-b7026fa26b0e/manager/0.log"
Nov 02 18:20:47.511563 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:47.511528    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-lckhg_3ba0d151-94e7-450f-8b5d-3873a538a8a9/cluster-monitoring-operator/0.log"
Nov 02 18:20:47.889615 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:47.889541    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chl28_9f681f52-04d7-42ce-8da1-908335437ae1/node-exporter/0.log"
Nov 02 18:20:47.912154 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:47.912132    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chl28_9f681f52-04d7-42ce-8da1-908335437ae1/kube-rbac-proxy/0.log"
Nov 02 18:20:47.934354 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:47.934330    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chl28_9f681f52-04d7-42ce-8da1-908335437ae1/init-textfile/0.log"
Nov 02 18:20:48.568552 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.568513    5054 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"]
Nov 02 18:20:48.569065 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569040    5054 cpu_manager.go:414] "containerMap: removing container" podUID="29bd5f86-c5f6-4d00-959b-aa352abc3119" containerName="maas-api"
Nov 02 18:20:48.569198 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569133    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29bd5f86-c5f6-4d00-959b-aa352abc3119" containerName="maas-api"
Nov 02 18:20:48.569273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569200    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569209    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569223    5054 cpu_manager.go:414] "containerMap: removing container" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569273 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569231    5054 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569472 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569375    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569472 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569390    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6643c43-2304-4529-af73-afc62bc27836" containerName="istio-proxy"
Nov 02 18:20:48.569472 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.569406    5054 memory_manager.go:365] "RemoveStaleState removing state" podUID="29bd5f86-c5f6-4d00-959b-aa352abc3119" containerName="maas-api"
Nov 02 18:20:48.572649 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.572629    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.578435 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.578402    5054 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4fmsl\"/\"default-dockercfg-md9st\""
Nov 02 18:20:48.580936 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.580915    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4fmsl\"/\"openshift-service-ca.crt\""
Nov 02 18:20:48.581493 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.581476    5054 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4fmsl\"/\"kube-root-ca.crt\""
Nov 02 18:20:48.583588 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.583565    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"]
Nov 02 18:20:48.699941 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.699897    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-lib-modules\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.699941 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.699941    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczzn\" (UniqueName: \"kubernetes.io/projected/929aecab-4506-405a-ae0b-35d6b4ff64fe-kube-api-access-kczzn\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.700169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.700045    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-proc\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.700169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.700085    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-podres\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.700169 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.700155    5054 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-sys\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801626 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801589    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-lib-modules\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801626 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801626    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczzn\" (UniqueName: \"kubernetes.io/projected/929aecab-4506-405a-ae0b-35d6b4ff64fe-kube-api-access-kczzn\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801657    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-proc\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801722    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-proc\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801740    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-lib-modules\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801748    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-podres\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801779    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-podres\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801798    5054 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-sys\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.801921 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.801884    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929aecab-4506-405a-ae0b-35d6b4ff64fe-sys\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.809703 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.809675    5054 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczzn\" (UniqueName: \"kubernetes.io/projected/929aecab-4506-405a-ae0b-35d6b4ff64fe-kube-api-access-kczzn\") pod \"perf-node-gather-daemonset-zppp4\" (UID: \"929aecab-4506-405a-ae0b-35d6b4ff64fe\") " pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:48.886865 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:48.886743    5054 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:49.164085 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:49.164054    5054 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"]
Nov 02 18:20:49.165900 ip-10-0-132-5 kubenswrapper[5054]: W1102 18:20:49.165852    5054 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod929aecab_4506_405a_ae0b_35d6b4ff64fe.slice/crio-0b9d3842bf87b56944d6aef45b624ae73d4e310b5deb029b054a8cf5ea4c7537 WatchSource:0}: Error finding container 0b9d3842bf87b56944d6aef45b624ae73d4e310b5deb029b054a8cf5ea4c7537: Status 404 returned error can't find the container with id 0b9d3842bf87b56944d6aef45b624ae73d4e310b5deb029b054a8cf5ea4c7537
Nov 02 18:20:49.695769 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:49.695742    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-rhvj2_563fcb27-3a4d-4348-a663-5df435315279/networking-console-plugin/0.log"
Nov 02 18:20:49.770897 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:49.770833    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4" event={"ID":"929aecab-4506-405a-ae0b-35d6b4ff64fe","Type":"ContainerStarted","Data":"9f890ba4245904247e298988f359130980ff70663f3f6edd7bdeca4cbecc905e"}
Nov 02 18:20:49.771077 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:49.770919    5054 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4" event={"ID":"929aecab-4506-405a-ae0b-35d6b4ff64fe","Type":"ContainerStarted","Data":"0b9d3842bf87b56944d6aef45b624ae73d4e310b5deb029b054a8cf5ea4c7537"}
Nov 02 18:20:49.771077 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:49.770951    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:50.345708 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:50.345680    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/1.log"
Nov 02 18:20:50.350262 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:50.350238    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-lgcz9_0d111045-5f11-4638-9002-179905dd2006/console-operator/2.log"
Nov 02 18:20:51.549438 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:51.549408    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-hlgbg_c660205d-a64f-4693-9175-dc3d82e75ecc/volume-data-source-validator/0.log"
Nov 02 18:20:52.841163 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:52.841135    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlnh4_60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/dns/0.log"
Nov 02 18:20:52.867420 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:52.867397    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlnh4_60a4d219-d7c3-4dce-b7fd-fa05c2fb7943/kube-rbac-proxy/0.log"
Nov 02 18:20:52.921139 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:52.921109    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5tc5_7bf1ac4f-ed4e-4fd8-ae47-5564e36c0229/dns-node-resolver/0.log"
Nov 02 18:20:53.618125 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:53.618082    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqvxr_cf4b7b16-845b-45bd-b139-62a876719b5c/node-ca/0.log"
Nov 02 18:20:54.636594 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:54.636563    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-lk4lv_009c4f65-25ea-4134-809b-4c5cfdda5ec3/istio-proxy/0.log"
Nov 02 18:20:55.788276 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:55.788234    5054 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4"
Nov 02 18:20:55.810730 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:55.810656    5054 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-4fmsl/perf-node-gather-daemonset-zppp4" podStartSLOduration=7.810630697 podStartE2EDuration="7.810630697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 18:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 18:20:49.810684003 +0000 UTC m=+2453.319446070" watchObservedRunningTime="2026-11-02 18:20:55.810630697 +0000 UTC m=+2459.319392768"
Nov 02 18:20:57.848694 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:57.848663    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/0.log"
Nov 02 18:20:57.850377 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:57.850354    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/1.log"
Nov 02 18:20:57.875587 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:57.875551    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2m464_5804f291-3559-4dda-9b22-ecbf6b2466fd/istio-proxy/0.log"
Nov 02 18:20:57.970567 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:57.970532    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9qwsm_ed01a4fb-b9a6-412a-9405-e5642d0ce442/istio-proxy/0.log"
Nov 02 18:20:58.094853 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:58.094776    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-qgrwq_39c672d2-c80e-4b1a-bfa9-70827effa6ae/istio-proxy/0.log"
Nov 02 18:20:58.169254 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:58.169227    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp_080990cb-5318-4cba-917d-35766ec311f3/istio-proxy/0.log"
Nov 02 18:20:58.202428 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:58.202399    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z2mhf_c78aa813-24d6-4641-8b94-f1f190f2a381/payload-pre-processing/0.log"
Nov 02 18:20:58.232422 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:58.232393    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:20:58.267190 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:58.267162    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86cdd8bc45-6t746_63887114-eb90-460e-a7ed-a4bf04e4fea6/router/0.log"
Nov 02 18:20:59.645771 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:59.645740    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-lk4lv_009c4f65-25ea-4134-809b-4c5cfdda5ec3/istio-proxy/0.log"
Nov 02 18:20:59.961314 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:20:59.961282    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t682l_203127f1-2169-422e-a508-793327fd6553/serve-healthcheck-canary/0.log"
Nov 02 18:21:00.601484 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.601452    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-j6zs5_442db46e-32cb-4277-a51c-fae4c064c817/insights-operator/1.log"
Nov 02 18:21:00.601807 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.601785    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-j6zs5_442db46e-32cb-4277-a51c-fae4c064c817/insights-operator/0.log"
Nov 02 18:21:00.632369 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.632343    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jb2qt_20498905-a7ee-4693-af66-069c9fe67f64/kube-rbac-proxy/0.log"
Nov 02 18:21:00.657000 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.656975    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jb2qt_20498905-a7ee-4693-af66-069c9fe67f64/exporter/0.log"
Nov 02 18:21:00.684726 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.684701    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jb2qt_20498905-a7ee-4693-af66-069c9fe67f64/extractor/0.log"
Nov 02 18:21:00.908642 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:00.908532    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-h6j78-vm6lh_50bc2622-2619-4153-b331-463aeeb3f56e/insights-gathering/0.log"
Nov 02 18:21:02.875539 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:02.875511    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/0.log"
Nov 02 18:21:02.877100 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:02.877081    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2h5cq_cb081cae-ffe6-4842-82fc-acd8683d6e87/istio-proxy/1.log"
Nov 02 18:21:02.890394 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:02.890372    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-2m464_5804f291-3559-4dda-9b22-ecbf6b2466fd/istio-proxy/0.log"
Nov 02 18:21:02.943293 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:02.943255    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9qwsm_ed01a4fb-b9a6-412a-9405-e5642d0ce442/istio-proxy/0.log"
Nov 02 18:21:03.018773 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.018745    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-qgrwq_39c672d2-c80e-4b1a-bfa9-70827effa6ae/istio-proxy/0.log"
Nov 02 18:21:03.056402 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.056371    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-bz8gp_080990cb-5318-4cba-917d-35766ec311f3/istio-proxy/0.log"
Nov 02 18:21:03.071258 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.071225    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z2mhf_c78aa813-24d6-4641-8b94-f1f190f2a381/payload-pre-processing/0.log"
Nov 02 18:21:03.085752 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.085728    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9nt6k_bb03fd59-1903-4e96-a3cf-2102886150c4/payload-processing/0.log"
Nov 02 18:21:03.109124 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.109091    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86cdd8bc45-6t746_63887114-eb90-460e-a7ed-a4bf04e4fea6/router/0.log"
Nov 02 18:21:03.724684 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.724656    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn_abb47248-964b-4a1c-abfd-aac7920caf67/manager/0.log"
Nov 02 18:21:03.754056 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:03.754031    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f4dd5dc4d-c2vhn_abb47248-964b-4a1c-abfd-aac7920caf67/copy-manifests/0.log"
Nov 02 18:21:05.068819 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:05.068784    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-rnkf6_3258a0b6-66b8-40a3-bfd2-3f8e5e392b04/jobset-operator/0.log"
Nov 02 18:21:05.304910 ip-10-0-132-5 kubenswrapper[5054]: I1102 18:21:05.304883    5054 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-lk4lv_009c4f65-25ea-4134-809b-4c5cfdda5ec3/istio-proxy/0.log"