Nov 02 20:14:19.564217 ip-10-0-134-201 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 20:14:19.986797 ip-10-0-134-201 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:14:19.986797 ip-10-0-134-201 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 20:14:19.986797 ip-10-0-134-201 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:14:19.986797 ip-10-0-134-201 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:14:19.991789 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991701    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:19.991789 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991786    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:19.991789 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991791    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:19.991789 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991794    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:19.991789 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991797    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991800    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991803    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991806    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991809    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991811    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991814    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991817    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991820    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991823    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991825    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991828    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991831    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991833    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991835    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991838    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991841    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991844    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991846    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991849    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:19.992002 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991851    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991857    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991861    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991864    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991866    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991869    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991871    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991874    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991876    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991879    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991882    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991885    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991887    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991890    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991894    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991896    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991899    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991901    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991904    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991907    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:19.992459 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991909    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991912    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991915    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991938    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991943    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991948    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991952    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991956    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991959    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991962    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991965    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991967    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991970    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991973    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991976    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991980    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991983    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991986    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991988    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:19.992978 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991991    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991995    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.991999    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992002    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992006    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992009    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992012    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992015    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992018    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992020    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992023    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992026    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992028    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992031    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992034    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992036    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992039    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992041    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992044    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:19.993422 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992047    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992050    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992052    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992055    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992057    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992060    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992062    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992065    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992068    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992070    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992073    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992075    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992078    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992081    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992083    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992086    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992088    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992091    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992094    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:19.993885 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992097    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:19.994350 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992101    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:19.994350 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992103    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:19.994350 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992106    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:19.994350 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.992109    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:19.996325 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996311    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:19.996325 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996324    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996327    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996331    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996334    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996336    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996339    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996342    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996344    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996347    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996351    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996354    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996356    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996361    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996365    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996367    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996370    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996373    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996375    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996378    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:19.996387 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996381    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996384    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996386    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996389    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996392    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996395    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996398    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996401    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996403    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996406    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996408    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996411    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996413    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996416    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996418    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996421    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996423    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996426    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996428    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996431    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:19.996857 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996433    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996436    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996438    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996441    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996444    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996447    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996450    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996453    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996455    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996458    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996460    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996463    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996466    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996468    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996471    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996473    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996476    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996478    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996481    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:19.997358 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996483    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996485    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996488    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996491    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996493    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996496    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996498    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996501    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996503    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996506    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996508    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996511    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996513    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996516    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996518    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996521    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996523    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996528    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996531    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996535    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:19.997812 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996539    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996542    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996546    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996548    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996552    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996555    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996557    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996560    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996563    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996566    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996569    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996571    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996574    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996576    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996579    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996582    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996584    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996587    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996589    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996592    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:19.998297 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996595    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996597    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996600    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996603    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996605    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996608    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.996610    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997118    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997124    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997128    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997132    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997136    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997139    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997141    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997144    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997147    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997151    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997155    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997158    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997161    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:19.998761 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997165    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997168    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997171    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997174    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997176    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997179    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997181    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997184    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997186    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997189    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997192    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997194    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997197    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997200    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997202    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997204    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997207    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997210    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997212    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997214    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:19.999264 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997217    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997221    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997226    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997229    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997232    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997235    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997238    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997241    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997243    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997246    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997248    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997251    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997253    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997256    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997258    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997261    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997263    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997266    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997268    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:19.999731 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997271    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997273    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997276    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997279    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997281    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997284    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997286    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997288    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997299    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997302    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997305    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997307    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997310    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997312    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997315    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997318    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997321    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997324    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997327    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997329    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.000215 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997332    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997335    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997337    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997340    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997342    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997345    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997347    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997350    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997352    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997355    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997357    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997360    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997363    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997366    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997368    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997371    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997373    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997376    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997378    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.000696 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997381    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997384    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997386    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997389    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997393    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997395    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997398    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997400    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997405    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997407    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997410    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997413    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997415    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997418    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.997420    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998363    2574 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998374    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998382    2574 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998386    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998390    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998393    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 20:14:20.001166 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998398    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998403    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998406    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998409    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998413    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998416    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998419    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998422    2574 flags.go:64] FLAG: --cgroup-root=""
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998425    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998428    2574 flags.go:64] FLAG: --client-ca-file=""
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998431    2574 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998434    2574 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998438    2574 flags.go:64] FLAG: --cluster-domain=""
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998441    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998444    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998447    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998450    2574 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998454    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998457    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998461    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998464    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998468    2574 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998472    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998475    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 20:14:20.001691 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998478    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998481    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998486    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998489    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998491    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998495    2574 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998498    2574 flags.go:64] FLAG: --enable-server="true"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998501    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998507    2574 flags.go:64] FLAG: --event-burst="100"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998510    2574 flags.go:64] FLAG: --event-qps="50"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998513    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998516    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998520    2574 flags.go:64] FLAG: --eviction-hard=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998524    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998527    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998530    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998534    2574 flags.go:64] FLAG: --eviction-soft=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998537    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998540    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998543    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998546    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998548    2574 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998551    2574 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998554    2574 flags.go:64] FLAG: --feature-gates=""
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998558    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 20:14:20.002316 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998561    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998564    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998568    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998571    2574 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998574    2574 flags.go:64] FLAG: --help="false"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998577    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998580    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998583    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998587    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998590    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998594    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998597    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998600    2574 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998603    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998606    2574 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998609    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998612    2574 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998615    2574 flags.go:64] FLAG: --kube-reserved=""
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998618    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998621    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998624    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998626    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998629    2574 flags.go:64] FLAG: --lock-file=""
Nov 02 20:14:20.002897 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998632    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998635    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998638    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998644    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998647    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998650    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998653    2574 flags.go:64] FLAG: --logging-format="text"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998656    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998659    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998662    2574 flags.go:64] FLAG: --manifest-url=""
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998665    2574 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998670    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998673    2574 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998677    2574 flags.go:64] FLAG: --max-pods="110"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998680    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998683    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998686    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998689    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998692    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998695    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998698    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998709    2574 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998712    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998715    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998719    2574 flags.go:64] FLAG: --pod-cidr=""
Nov 02 20:14:20.003478 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998722    2574 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998725    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998728    2574 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998731    2574 flags.go:64] FLAG: --port="10250"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998734    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998737    2574 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-03d80495a777bac00"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998740    2574 flags.go:64] FLAG: --qos-reserved=""
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998743    2574 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998746    2574 flags.go:64] FLAG: --register-node="true"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998749    2574 flags.go:64] FLAG: --register-with-taints=""
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998753    2574 flags.go:64] FLAG: --registry-burst="10"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998756    2574 flags.go:64] FLAG: --registry-qps="5"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998759    2574 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998762    2574 flags.go:64] FLAG: --reserved-memory=""
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998766    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998769    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998772    2574 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998775    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998778    2574 flags.go:64] FLAG: --runonce="false"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998782    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998785    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998788    2574 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998791    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998794    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998797    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998800    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 20:14:20.004075 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998803    2574 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998806    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998810    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998813    2574 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998816    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998819    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998822    2574 flags.go:64] FLAG: --system-cgroups=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998827    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998832    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998835    2574 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998838    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998842    2574 flags.go:64] FLAG: --tls-min-version=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998845    2574 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998848    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998850    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998853    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998856    2574 flags.go:64] FLAG: --v="2"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998861    2574 flags.go:64] FLAG: --version="false"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998865    2574 flags.go:64] FLAG: --vmodule=""
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998869    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.998873    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999021    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999025    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999029    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.004694 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999032    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999035    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999037    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999040    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999042    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999045    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999047    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999050    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999054    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999056    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999061    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999063    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999066    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999069    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999071    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999075    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999078    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999080    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999083    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999085    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.005310 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999088    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999091    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999094    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999097    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999099    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999102    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999104    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999107    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999110    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999112    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999115    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999118    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999120    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999123    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999125    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999128    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999131    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999134    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999136    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999139    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:20.005784 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999142    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999144    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999148    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999151    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999153    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999156    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999158    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999163    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999165    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999168    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999171    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999174    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999176    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999179    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999181    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999184    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999186    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999189    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999191    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999194    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.006313 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999196    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999199    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999201    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999204    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999206    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999209    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999211    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999214    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999217    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999219    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999222    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999224    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999227    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999230    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999234    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999236    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999239    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999241    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:20.006787 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999244    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999249    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999253    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999256    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999259    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999262    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999265    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999268    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999271    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999273    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999276    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999279    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999282    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999284    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999287    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999289    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999292    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999294    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999297    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.007236 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999299    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999303    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999307    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999310    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999313    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999316    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:19.999342    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999378    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999382    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999385    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999389    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999392    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999394    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999397    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999401    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:20.007677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999403    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999406    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999409    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999411    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999414    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999416    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999419    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999422    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999424    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999427    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999429    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999432    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999435    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999437    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999440    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999442    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999445    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999447    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999450    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999452    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.008056 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999455    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999457    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999460    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999463    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999465    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999467    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999470    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999474    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999477    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999479    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999482    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999486    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999488    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999491    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999494    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999496    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999499    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999501    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999504    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999507    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.008533 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999509    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999512    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999515    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999517    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999520    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999522    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999525    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999527    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999530    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999533    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999535    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999538    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999540    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999543    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999545    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999548    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999550    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999553    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999555    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:20.009024 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999558    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999561    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999564    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999566    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999570    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999573    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999575    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999579    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999583    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999586    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999588    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999591    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999594    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999597    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999599    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999602    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999604    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999607    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999609    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.009470 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999612    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999614    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999617    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999620    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999622    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999625    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999627    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999631    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999634    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999638    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999640    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999643    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999646    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999648    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999652    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999661    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999664    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999668    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999671    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.009931 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:19.999673    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.006475    2574 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.006606    2574 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.006623    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.006628    2574 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006684    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006690    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006693    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006696    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006699    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006702    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006705    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006708    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006711    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006713    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006716    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006719    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006722    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006725    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006728    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:20.010398 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006731    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006733    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006736    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006739    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006742    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006744    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006747    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006750    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006752    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006755    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006757    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006760    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006762    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006765    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006769    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006771    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006774    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006776    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006779    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006781    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:20.010871 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006784    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006786    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006789    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006792    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006795    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006798    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006800    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006804    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006808    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006811    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006814    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006816    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006819    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006821    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006824    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006827    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006829    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006832    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006834    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.011482 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006837    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006840    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006842    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006845    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006847    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006850    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006853    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006855    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006859    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006861    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006864    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006867    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006869    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006872    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006874    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006877    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006880    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006884    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006887    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:20.011986 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006890    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006893    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006895    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006898    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006901    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006903    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006906    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006908    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006911    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006913    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006927    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006931    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006933    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006936    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006939    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006942    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006944    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006947    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006950    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006952    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:20.012456 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006955    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006958    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006961    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006964    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006967    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006969    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006972    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006974    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006977    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006979    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006982    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006984    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.006987    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.007014    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007154    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007158    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.012936 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007162    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007165    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007167    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007170    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007173    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007175    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007178    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007181    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007183    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007186    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007189    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007191    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007194    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007197    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007199    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007202    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007204    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007207    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007210    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007213    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:20.013513 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007215    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007218    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007220    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007223    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007225    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007228    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007231    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007233    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007236    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007239    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007242    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007244    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007247    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007250    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007252    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007255    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007257    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007260    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007262    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007265    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:20.014400 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007267    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007270    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007272    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007275    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007277    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007280    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007282    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007285    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007288    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007291    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007293    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007296    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007299    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007302    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007304    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007307    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007310    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007314    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007317    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:20.015155 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007320    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007325    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007327    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007330    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007333    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007335    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007338    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007340    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007343    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007345    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007349    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007353    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007356    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007359    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007363    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007367    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007370    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007373    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007375    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:20.015599 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007378    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007381    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007383    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007386    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007389    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007392    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007394    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007398    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007401    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007403    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007406    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007408    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007411    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007414    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007417    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007420    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007423    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007425    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007428    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:20.016067 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007431    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007433    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007436    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007438    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007441    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007444    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007446    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.007469    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007500    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007505    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007507    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007511    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007514    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007517    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007521    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:14:20.016505 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007524    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007527    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007530    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007534    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007538    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007541    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007544    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007547    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007550    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007552    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007555    2574 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007557    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007561    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007564    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007567    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007570    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007572    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007575    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007577    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:14:20.016870 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007580    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007583    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007585    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007588    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007590    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007593    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007596    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007598    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007600    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007603    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007606    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007608    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007611    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007613    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007616    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007618    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007621    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007623    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007625    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:14:20.017332 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007628    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007631    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007634    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007637    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007639    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007641    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007644    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007648    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007651    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007653    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007656    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007659    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007661    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007664    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007666    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007669    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007671    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007674    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007677    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007680    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:14:20.017771 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007682    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007685    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007688    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007690    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007693    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007695    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007698    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007701    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007703    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007706    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007708    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007711    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007714    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007716    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007719    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007722    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007724    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007726    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007729    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007733    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:14:20.018404 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007736    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007739    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007741    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007744    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007746    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007749    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007752    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007754    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007757    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007759    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007762    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007765    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007767    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007770    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007772    2574 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007775    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007777    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007782    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007785    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:14:20.018974 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007788    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:20.007791    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.007843    2574 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.010228    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.011170    2574 server.go:1014] "Starting client certificate rotation"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.011281    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.011330    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.014228    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 20:14:20.019445 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.018031    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 20:14:20.030648 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.030630    2574 log.go:25] "Validated CRI v1 runtime API"
Nov 02 20:14:20.033814 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.033798    2574 log.go:25] "Validated CRI v1 image API"
Nov 02 20:14:20.034561 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.034533    2574 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 20:14:20.037138 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.037119    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ada075e7-129d-4f67-8d12-77c82c8f8cc1:/dev/nvme0n1p4 cbaf8f4f-fd31-4bb5-a91a-0dc0f732cf25:/dev/nvme0n1p3]
Nov 02 20:14:20.037192 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.037138    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 02 20:14:20.042017 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.041899    2574 manager.go:217] Machine: {Timestamp:2026-11-02 20:14:20.041440217 +0000 UTC m=+0.355753582 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093109 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec226d6829c2b670b202241ee416609e SystemUUID:ec226d68-29c2-b670-b202-241ee416609e BootID:e903b0ab-273d-4550-b323-e37431480b46 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:f4:d1:aa:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:f4:d1:aa:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:e5:e1:13:e2:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 20:14:20.042017 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.042017    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 20:14:20.042128 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.042116    2574 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 20:14:20.045549 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045520    2574 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 20:14:20.045685 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045545    2574 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-201.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 20:14:20.045734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045687    2574 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 20:14:20.045734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045695    2574 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 20:14:20.045734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045720    2574 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 20:14:20.045815 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.045738    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 20:14:20.046668 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.046658    2574 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 20:14:20.050084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.050072    2574 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 20:14:20.050344 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.050334    2574 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 20:14:20.051305 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051296    2574 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 20:14:20.051338 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051310    2574 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 20:14:20.051338 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051321    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 20:14:20.051338 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051332    2574 kubelet.go:405] "Adding apiserver pod source"
Nov 02 20:14:20.051456 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051340    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 20:14:20.051667 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.051651    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 20:14:20.054559 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.054539    2574 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 20:14:20.060017 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.060005    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 20:14:20.062101 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062077    2574 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 20:14:20.062180 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062134    2574 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 20:14:20.062361 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062346    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 20:14:20.062412 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062378    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 20:14:20.062412 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062389    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 20:14:20.062412 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062399    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 20:14:20.062521 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062415    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 20:14:20.062521 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.062424    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 20:14:20.063158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063138    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 20:14:20.063218 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063165    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 20:14:20.063218 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063182    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 20:14:20.063218 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063193    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 20:14:20.063218 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063207    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 20:14:20.063436 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.063223    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 20:14:20.064081 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.064066    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 20:14:20.064135 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.064093    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 20:14:20.068817 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.068802    2574 server.go:1263] "Started kubelet"
Nov 02 20:14:20.068959 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.068898    2574 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 20:14:20.069127 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.068896    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 20:14:20.069180 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.069144    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 20:14:20.069633 ip-10-0-134-201 systemd[1]: Started Kubernetes Kubelet.
Nov 02 20:14:20.070429 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.070217    2574 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 20:14:20.071891 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.071871    2574 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 20:14:20.075517 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.075500    2574 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 20:14:20.075601 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.075523    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 20:14:20.075601 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.075594    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-201.us-west-2.compute.internal\" not found"
Nov 02 20:14:20.076301 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.076283    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 20:14:20.076376 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.076286    2574 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 20:14:20.076376 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.076313    2574 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 20:14:20.076474 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.076410    2574 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 20:14:20.076474 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.076421    2574 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 20:14:20.077326 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077299    2574 factory.go:153] Registering CRI-O factory
Nov 02 20:14:20.077326 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077318    2574 factory.go:223] Registration of the crio container factory successfully
Nov 02 20:14:20.077456 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.077387    2574 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 02 20:14:20.077533 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077517    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 20:14:20.077655 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077638    2574 factory.go:55] Registering systemd factory
Nov 02 20:14:20.077655 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077654    2574 factory.go:223] Registration of the systemd container factory successfully
Nov 02 20:14:20.077788 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077669    2574 factory.go:103] Registering Raw factory
Nov 02 20:14:20.077788 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.077678    2574 manager.go:1199] Started watching for new ooms in manager
Nov 02 20:14:20.078597 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.078585    2574 manager.go:319] Starting recovery of all containers
Nov 02 20:14:20.088533 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.087770    2574 manager.go:324] Recovery completed
Nov 02 20:14:20.094197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.094184    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.095845 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.095827    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.095929 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.095858    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.095929 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.095872    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.096376 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.096364    2574 cpu_manager.go:226] "Starting" policy="none"
Nov 02 20:14:20.096417 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.096375    2574 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 20:14:20.096417 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.096392    2574 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 20:14:20.096480 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.096366    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.097063 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097047    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.097151 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097075    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.097151 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097086    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.097764 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097752    2574 policy_none.go:50] "Start"
Nov 02 20:14:20.097810 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097768    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 20:14:20.097810 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.097778    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 20:14:20.098889 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.098880    2574 policy_none.go:44] "Start"
Nov 02 20:14:20.146572 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.146546    2574 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 20:14:20.149531 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.149514    2574 manager.go:341] "Starting Device Plugin manager"
Nov 02 20:14:20.149615 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.149562    2574 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 20:14:20.149615 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.149574    2574 server.go:87] "Starting device plugin registration server"
Nov 02 20:14:20.149827 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.149814    2574 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 20:14:20.149887 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.149829    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 20:14:20.150004 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.149985    2574 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 20:14:20.150097 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.150066    2574 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 20:14:20.150097 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.150074    2574 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 20:14:20.150528 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.150507    2574 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 20:14:20.150597 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.150558    2574 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-201.us-west-2.compute.internal\" not found"
Nov 02 20:14:20.218968 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.218943    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 20:14:20.220080 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.220065    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 20:14:20.220132 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.220089    2574 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 20:14:20.220132 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.220108    2574 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 20:14:20.220208 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.220136    2574 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 02 20:14:20.250104 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.250028    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.250859 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.250842    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.250951 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.250872    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.250951 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.250884    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.250951 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.250908    2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.320862 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.320824    2574 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"]
Nov 02 20:14:20.321014 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.320897    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.321833 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.321818    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.321873 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.321855    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.321873 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.321867    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.323290 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.323278    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.323434 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.323418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.323482 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.323450    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.324029 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324013    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.324029 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324021    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.324129 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324042    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.324129 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324042    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.324129 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324052    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.324129 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.324062    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.325382 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.325368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.325450 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.325389    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:20.326091 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.326075    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:20.326172 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.326102    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:20.326172 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.326117    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:20.337819 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.337800    2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 20:14:20.337909 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.337853    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7r2hl"
Nov 02 20:14:20.352605 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.352574    2574 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-201.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 02 20:14:20.352862 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.352837    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-201.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 02 20:14:20.353471 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.352538    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-201.us-west-2.compute.internal.18e453971b9d83f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-201.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-201.us-west-2.compute.internal,},FirstTimestamp:2026-11-02 20:14:20.068774902 +0000 UTC m=+0.383088264,LastTimestamp:2026-11-02 20:14:20.068774902 +0000 UTC m=+0.383088264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-201.us-west-2.compute.internal,}"
Nov 02 20:14:20.356838 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.356816    2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-201.us-west-2.compute.internal\" not found" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.360669 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.360652    2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-201.us-west-2.compute.internal\" not found" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.378191 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.378170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.378262 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.378195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.378262 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.378213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.411533 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.411514    2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:20.411533 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.411523    2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:20.415016 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.415001    2574 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:20.478364 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.478468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.478468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.478468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478423    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.478468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478432    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.478610 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.478426    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.511587 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.511532    2574 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-201.us-west-2.compute.internal\" not found" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.514310 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.513242    2574 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:20.656975 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:20.656947    2574 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-201.us-west-2.compute.internal\" not found" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.660042 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.660026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:20.664250 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:20.664118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:21.940822 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:21.940807    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:14:21.941586 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:21.941571    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:14:21.941648 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:21.941597    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:14:21.941648 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:21.941608    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:14:21.941648 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:21.941633    2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:22.000382 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.000339    2574 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:22.005530 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.005511    2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:22.115534 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.115513    2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:14:22.115645 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.115603    2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:14:22.173479 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.173458    2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:14:22.240127 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.240110    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 02 20:14:22.240585 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.240258    2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 20:14:22.240585 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.240281    2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 20:14:22.240585 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.240288    2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 20:14:22.240585 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.240231    2574 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a005d902b89f44e8db632ef0d2b795eb-22154488e9922e7d.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-134-201.us-west-2.compute.internal.18e453971d3b099e\": read tcp 10.0.134.201:42732->18.189.9.172:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-134-201.us-west-2.compute.internal.18e453971d3b099e  default   5419 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-201.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-201.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-201.us-west-2.compute.internal,},FirstTimestamp:2026-11-02 20:14:20 +0000 UTC,LastTimestamp:2026-11-02 20:14:20.250888358 +0000 UTC m=+0.565201720,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-201.us-west-2.compute.internal,}"
Nov 02 20:14:22.281076 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.281021    2574 apiserver.go:52] "Watching apiserver"
Nov 02 20:14:22.304906 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.304886    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 02 20:14:22.527490 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.527460    2574 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 20:14:22.527860 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.527838    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9cldl","openshift-multus/multus-k5cwd","kube-system/global-pull-secret-syncer-wzb8x","kube-system/konnectivity-agent-mtm8t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt","openshift-network-operator/iptables-alerter-kdwv2","kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal","openshift-multus/network-metrics-daemon-9lcqr","openshift-ovn-kubernetes/ovnkube-node-6dfn5","openshift-image-registry/node-ca-m2nwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-dpm95","openshift-network-diagnostics/network-check-target-dng75"]
Nov 02 20:14:22.529938 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.529920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.531226 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.531176    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.532722 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.532708    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.534051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.534038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.535372 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.535358    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.536624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.536608    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.537970 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.537955    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.538046 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.538029    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:22.539343 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.539330    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.539648 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.539590    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:22.541499 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.541437    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.543350 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.543334    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.544815 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.544798    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bx89s"]
Nov 02 20:14:22.544890 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.544877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:22.544940 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.544926    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:22.546157 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.546144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.570980 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.570943    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 20:09:21 +0000 UTC" deadline="2028-08-13 01:24:49.555448344 +0000 UTC"
Nov 02 20:14:22.570980 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.570978    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15581h10m26.984472901s"
Nov 02 20:14:22.580336 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580214    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 20:14:22.580564 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580543    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.580639 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580611    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7m5tr\""
Nov 02 20:14:22.580708 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580641    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-t6dvk\""
Nov 02 20:14:22.580708 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580697    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.580820 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580727    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 20:14:22.580820 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580806    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 20:14:22.580915 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580822    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 20:14:22.580915 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580852    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.580915 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580896    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.581045 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580944    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 20:14:22.581045 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.580995    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 20:14:22.581045 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.581000    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 20:14:22.581045 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.581026    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 20:14:22.581194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.581179    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-ldshw\""
Nov 02 20:14:22.581980 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.581964    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 20:14:22.606304 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.606288    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 20:14:22.612959 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.612941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.613030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.612965    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.613030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.612981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgg8\" (UniqueName: \"kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.613030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.612995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.613030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613009    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.613030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vfx2\" (UniqueName: \"kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.613268 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613445    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzd6\" (UniqueName: \"kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prfp5\" (UniqueName: \"kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.613602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613583    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zn8q\" (UniqueName: \"kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.613990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614142 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxgmb\" (UniqueName: \"kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtjx\" (UniqueName: \"kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.614775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjx2\" (UniqueName: \"kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614503    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614538    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614551    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614576    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wk78\" (UniqueName: \"kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:22.615221 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.615641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.615641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.615641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.615641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.615641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.614818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.626111 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.626096    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.626195 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.626148    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.626319 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.626305    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xxqx9\""
Nov 02 20:14:22.626362 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.626339    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qfmz2\""
Nov 02 20:14:22.684186 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684158    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.684294 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684163    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.684294 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684172    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 20:14:22.684294 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684206    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.684506 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684489    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjrtf\""
Nov 02 20:14:22.684506 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684498    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684506    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kz985\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684490    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684505    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684531    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684544    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684554    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684534    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hxslf\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684565    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5vs7j\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684586    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684584    2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 20:14:22.684624 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684601    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 20:14:22.684955 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.684650    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2chmr"
Nov 02 20:14:22.715869 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.715944 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.715944 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgg8\" (UniqueName: \"kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.715944 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.715944 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.715973    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716001    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716007    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716028    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716058    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.716156 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vfx2\" (UniqueName: \"kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716217    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716343    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716328    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716496    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716270    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.716551 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716562    2574 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716581    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716602    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716605    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzd6\" (UniqueName: \"kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716676    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prfp5\" (UniqueName: \"kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716711    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716773    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.717197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716819    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716848    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716888    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716896    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716917    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716942    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716931    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.716989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717052    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717152    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.718051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717204    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zn8q\" (UniqueName: \"kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717224    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717237    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717269    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717312    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717354    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717402    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717432    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717464    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717482    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.718835 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717536    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgmb\" (UniqueName: \"kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtjx\" (UniqueName: \"kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717621    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717679    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717712    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717854    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717862    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717900    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.719602 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.717980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718058    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718110    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718217    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjx2\" (UniqueName: \"kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718263    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718180    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718303    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720158 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718334    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.718350    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718381    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718150    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.718439    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:23.218418279 +0000 UTC m=+2.303965545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718446    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718457    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718500    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718543    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718578    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.718663    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718659    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.718742    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:23.218725785 +0000 UTC m=+2.304273034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wk78\" (UniqueName: \"kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.720882 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.718983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719153    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719242    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719336    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719382    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719439    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.719561    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720473    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721383 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720508    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.721848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720546    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.721848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720661    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.721848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720803    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.721848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.720860    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.775916 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.775178    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:22.776057 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.775926    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:22.776057 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.775942    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:22.776057 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:22.776047    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:23.276012788 +0000 UTC m=+2.361560055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:22.776331 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.776295    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgg8\" (UniqueName: \"kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.776654 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.776631    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzd6\" (UniqueName: \"kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.776776 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.776758    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wk78\" (UniqueName: \"kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.776978 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.776947    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjx2\" (UniqueName: \"kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.777197 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.777174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtjx\" (UniqueName: \"kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:22.778384 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.778352    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zn8q\" (UniqueName: \"kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:22.778536 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.778521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgmb\" (UniqueName: \"kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.778590 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.778536    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vfx2\" (UniqueName: \"kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.779172 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.779156    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prfp5\" (UniqueName: \"kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:22.873137 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.873071    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:22.883124 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.883100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5cwd"
Nov 02 20:14:22.906465 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.906428    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:22.906958 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.906927    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca97178_94dc_4858_9824_06c0c0e91c03.slice/crio-628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a WatchSource:0}: Error finding container 628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a: Status 404 returned error can't find the container with id 628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a
Nov 02 20:14:22.908111 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.908084    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb526d8000ee2153ea8f69907c814c3ac.slice/crio-e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f WatchSource:0}: Error finding container e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f: Status 404 returned error can't find the container with id e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f
Nov 02 20:14:22.908835 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.908810    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc49763_535f_43b4_979f_ff8d1e726222.slice/crio-b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0 WatchSource:0}: Error finding container b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0: Status 404 returned error can't find the container with id b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0
Nov 02 20:14:22.909728 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.909681    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5437ce875acadcf23a36788079a5aa7.slice/crio-5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972 WatchSource:0}: Error finding container 5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972: Status 404 returned error can't find the container with id 5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972
Nov 02 20:14:22.912667 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.912644    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:14:22.915156 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.915135    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66dfdd5f_6703_4846_bcb0_83f49098bc5f.slice/crio-208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3 WatchSource:0}: Error finding container 208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3: Status 404 returned error can't find the container with id 208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3
Nov 02 20:14:22.929542 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.929522    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:14:22.936869 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.936850    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c50dd7_2082_4b1f_bfe0_0d4568f329bb.slice/crio-b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846 WatchSource:0}: Error finding container b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846: Status 404 returned error can't find the container with id b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846
Nov 02 20:14:22.939916 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.939896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:14:22.946348 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.946329    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b9a022_00f8_447c_881d_a9b045ae1196.slice/crio-f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2 WatchSource:0}: Error finding container f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2: Status 404 returned error can't find the container with id f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2
Nov 02 20:14:22.956511 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.956495    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:14:22.963631 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.963603    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5313f6_f18b_493a_812a_8a6fccccaf0e.slice/crio-01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09 WatchSource:0}: Error finding container 01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09: Status 404 returned error can't find the container with id 01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09
Nov 02 20:14:22.976920 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:22.976902    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:14:22.984309 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:22.984287    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3c02ba_eb10_4b76_a903_17c55cd5b011.slice/crio-1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e WatchSource:0}: Error finding container 1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e: Status 404 returned error can't find the container with id 1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e
Nov 02 20:14:23.001557 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.001537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:14:23.002623 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.002604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:14:23.009402 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:23.009381    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8dbfb9_508d_4a99_9508_8d9a3b5b749d.slice/crio-9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7 WatchSource:0}: Error finding container 9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7: Status 404 returned error can't find the container with id 9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7
Nov 02 20:14:23.011341 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:14:23.011321    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23577fb2_f316_4afa_bc93_fb8cd1ff75a4.slice/crio-a80ae23c0000863faf88bb3ee8db547cda7574a3940b738cac005446a917cdbb WatchSource:0}: Error finding container a80ae23c0000863faf88bb3ee8db547cda7574a3940b738cac005446a917cdbb: Status 404 returned error can't find the container with id a80ae23c0000863faf88bb3ee8db547cda7574a3940b738cac005446a917cdbb
Nov 02 20:14:23.013475 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.013426    2574 kuberuntime_manager.go:1707] "Unhandled Error" err="container tuned start failed in pod tuned-bx89s_openshift-cluster-node-tuning-operator(23577fb2-f316-4afa-bc93-fb8cd1ff75a4): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Nov 02 20:14:23.013539 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.013488    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-bx89s" podUID="23577fb2-f316-4afa-bc93-fb8cd1ff75a4"
Nov 02 20:14:23.222363 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.222272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:23.222363 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.222312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:23.222543 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.222410    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:23.222543 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.222413    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:23.222543 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.222469    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:24.222457679 +0000 UTC m=+3.308004927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:23.222543 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.222485    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:24.222478651 +0000 UTC m=+3.308025898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:23.295186 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.295158    2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:23.323592 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.323556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:23.323733 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.323722    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:23.323786 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.323740    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:23.323786 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.323750    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:23.323853 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.323798    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:24.323785657 +0000 UTC m=+3.409332918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:23.453369 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.453314    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5cwd" event={"ID":"cfc49763-535f-43b4-979f-ff8d1e726222","Type":"ContainerStarted","Data":"b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0"}
Nov 02 20:14:23.454402 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.454375    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bx89s" event={"ID":"23577fb2-f316-4afa-bc93-fb8cd1ff75a4","Type":"ContainerStarted","Data":"a80ae23c0000863faf88bb3ee8db547cda7574a3940b738cac005446a917cdbb"}
Nov 02 20:14:23.455468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.455436    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerStarted","Data":"9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7"}
Nov 02 20:14:23.456036 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:23.456001    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-bx89s" podUID="23577fb2-f316-4afa-bc93-fb8cd1ff75a4"
Nov 02 20:14:23.456508 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.456491    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a"}
Nov 02 20:14:23.457400 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.457381    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"b526d8000ee2153ea8f69907c814c3ac","Type":"ContainerStarted","Data":"e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f"}
Nov 02 20:14:23.458300 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.458284    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2nwz" event={"ID":"4a3c02ba-eb10-4b76-a903-17c55cd5b011","Type":"ContainerStarted","Data":"1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e"}
Nov 02 20:14:23.459185 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.459169    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cldl" event={"ID":"3e5313f6-f18b-493a-812a-8a6fccccaf0e","Type":"ContainerStarted","Data":"01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09"}
Nov 02 20:14:23.461982 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.461962    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdwv2" event={"ID":"86b9a022-00f8-447c-881d-a9b045ae1196","Type":"ContainerStarted","Data":"f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2"}
Nov 02 20:14:23.463017 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.462998    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt" event={"ID":"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb","Type":"ContainerStarted","Data":"b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846"}
Nov 02 20:14:23.464019 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.464002    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mtm8t" event={"ID":"66dfdd5f-6703-4846-bcb0-83f49098bc5f","Type":"ContainerStarted","Data":"208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3"}
Nov 02 20:14:23.464949 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.464932    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerStarted","Data":"5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972"}
Nov 02 20:14:23.499040 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.498960    2574 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:23.686501 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.686454    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 20:09:22 +0000 UTC" deadline="2028-08-06 11:55:00.98926882 +0000 UTC"
Nov 02 20:14:23.686501 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.686494    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15423h40m37.302777454s"
Nov 02 20:14:23.728048 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:23.728016    2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:14:24.231007 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.230750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:24.231007 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.230794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:24.231007 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.230973    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:24.231308 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.231028    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:26.231011348 +0000 UTC m=+5.316558602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:24.231308 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.231091    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:24.231308 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.231122    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:26.231111824 +0000 UTC m=+5.316659076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:24.331697 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.331646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:24.332166 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.331877    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:24.332166 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.331898    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:24.332166 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.331910    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:24.332166 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.331965    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:26.33194898 +0000 UTC m=+5.417496230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:24.450043 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.450010    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:24.450220 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.450138    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:24.450220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.450216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:24.450346 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.450290    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:24.450457 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.450440    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:24.450571 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:24.450552    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:24.687394 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.687291    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 20:09:22 +0000 UTC" deadline="2028-04-25 12:00:59.290545336 +0000 UTC"
Nov 02 20:14:24.687394 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:24.687323    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12951h46m34.603226247s"
Nov 02 20:14:26.249651 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.249568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:26.249651 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.249623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:26.250305 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.249775    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:26.250305 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.249841    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:30.249819978 +0000 UTC m=+9.335367242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:26.250305 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.249905    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:26.250305 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.249938    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:30.249927216 +0000 UTC m=+9.335474470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:26.350791 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.350755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:26.350956 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.350931    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:26.350956 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.350955    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:26.351066 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.350969    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:26.351066 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.351029    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:30.351011002 +0000 UTC m=+9.436558268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:26.449912 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.449880    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:26.450085 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.450015    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:26.450143 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.450098    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:26.450200 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.450180    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:26.450247 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:26.450236    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:26.450322 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:26.450306    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:27.502232 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:27.502196    2574 generic.go:356] "Generic (PLEG): container finished" podID="a5437ce875acadcf23a36788079a5aa7" containerID="c435d83b387df0ee27e63d32fdb3b183d7fdd2f02f769463c1df3d843000db4d" exitCode=0
Nov 02 20:14:27.502922 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:27.502292    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerDied","Data":"c435d83b387df0ee27e63d32fdb3b183d7fdd2f02f769463c1df3d843000db4d"}
Nov 02 20:14:27.511314 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:27.510708    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="9e083ebfb656f7d6360316c62f74d87adfb3048bd8248f1cf13097456cc66737" exitCode=0
Nov 02 20:14:27.511314 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:27.510751    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"9e083ebfb656f7d6360316c62f74d87adfb3048bd8248f1cf13097456cc66737"}
Nov 02 20:14:28.449873 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.449837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:28.450023 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:28.449974    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:28.450083 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.450044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:28.450161 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:28.450110    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:28.450225 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.450164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:28.450276 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:28.450243    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:28.516726 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.516673    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mtm8t" event={"ID":"66dfdd5f-6703-4846-bcb0-83f49098bc5f","Type":"ContainerStarted","Data":"6fca64a90923874f9a2d4378842ee57695490ddf646386576d3bb37ed058dc73"}
Nov 02 20:14:28.522629 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.522601    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerStarted","Data":"5820524a573119c6f9581ff059a9f83c243e7974ffdfd87bbe34f241057f4304"}
Nov 02 20:14:28.525444 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.525412    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"b526d8000ee2153ea8f69907c814c3ac","Type":"ContainerStarted","Data":"ad4be1cf3e0073c422e2e88ada179bdac902b2a0ae3d5e74957376ba94763631"}
Nov 02 20:14:28.736367 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.736302    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mtm8t" podStartSLOduration=2.231385069 podStartE2EDuration="6.736281121s" totalImagesPullingTime="4.504896052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:28.625908323 +0000 UTC m=+7.711455595" watchObservedRunningTime="2026-11-02 20:14:28.736281121 +0000 UTC m=+7.821828392"
Nov 02 20:14:28.842222 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.842160    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal" podStartSLOduration=6.842139133 podStartE2EDuration="6.842139133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:28.841628696 +0000 UTC m=+7.927175969" watchObservedRunningTime="2026-11-02 20:14:28.842139133 +0000 UTC m=+7.927686405"
Nov 02 20:14:28.842588 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:28.842543    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" podStartSLOduration=6.8425299299999995 podStartE2EDuration="6.84252993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:28.736784725 +0000 UTC m=+7.822332000" watchObservedRunningTime="2026-11-02 20:14:28.84252993 +0000 UTC m=+7.928077202"
Nov 02 20:14:29.531183 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:29.531109    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2nwz" event={"ID":"4a3c02ba-eb10-4b76-a903-17c55cd5b011","Type":"ContainerStarted","Data":"0adf5f393c3f0e1d07b2f9ef77edb6f1a434e635d917bb4bf6df5812d061e1e5"}
Nov 02 20:14:29.533959 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:29.533933    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt" event={"ID":"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb","Type":"ContainerStarted","Data":"adc670613bb7916ae2c42e14821294c44a5acc3a0f31e215e567586f17b48fab"}
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.280504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.280568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.280754    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.280813    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:38.280796391 +0000 UTC m=+17.366343643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.281191    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:30.281328 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.281241    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:38.281226286 +0000 UTC m=+17.366773549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:30.381582 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.381266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:30.381582 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.381436    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:30.381582 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.381471    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:30.381582 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.381483    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:30.381582 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.381538    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:38.381520371 +0000 UTC m=+17.467067620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:30.449917 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.449883    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:30.450103 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.450079    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:30.450465 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.450446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:30.450567 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.450547    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:30.450616 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:30.450604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:30.450736 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:30.450713    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:31.186189 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.186159    2574 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 20:14:31.383209 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.383112    2574 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T20:14:31.186181368Z","UUID":"b2114a86-ada5-4287-a90d-fc886fcd05df","Handler":null,"Name":"","Endpoint":""}
Nov 02 20:14:31.384737 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.384718    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 20:14:31.384866 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.384744    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 20:14:31.544746 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.544714    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cldl" event={"ID":"3e5313f6-f18b-493a-812a-8a6fccccaf0e","Type":"ContainerStarted","Data":"6cd8d816221c699f3f0f1976f3e9a3ad0eb9c45b98b7f401fc74d18ae4c4dacb"}
Nov 02 20:14:31.546894 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.546869    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt" event={"ID":"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb","Type":"ContainerStarted","Data":"fba4641565bc176d9386bda9d9c1231adea63f7b69d9aa8d36f63311bd182d76"}
Nov 02 20:14:31.548656 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.548313    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5cwd" event={"ID":"cfc49763-535f-43b4-979f-ff8d1e726222","Type":"ContainerStarted","Data":"779a360d8d08dc49c6223d621c92916fe2a2557b5c5b7d2672b3448e43db43ac"}
Nov 02 20:14:31.550099 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.550076    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerStarted","Data":"932b71526f77bca8d2a8fc0e639a2fa5f2525991a951e8d52be52211ead5b776"}
Nov 02 20:14:31.651864 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.651762    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2nwz" podStartSLOduration=4.105798202 podStartE2EDuration="9.651744965s" totalImagesPullingTime="5.545946763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:29.640031463 +0000 UTC m=+8.725578735" watchObservedRunningTime="2026-11-02 20:14:31.651744965 +0000 UTC m=+10.737292235"
Nov 02 20:14:31.652027 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.652002    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-9cldl" podStartSLOduration=1.73526515 podStartE2EDuration="9.651994422s" totalImagesPullingTime="7.916729272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:31.651441117 +0000 UTC m=+10.736988386" watchObservedRunningTime="2026-11-02 20:14:31.651994422 +0000 UTC m=+10.737541691"
Nov 02 20:14:31.848709 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.848669    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:31.849429 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.849402    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:31.876147 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:31.876104    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-k5cwd" podStartSLOduration=3.28378958 podStartE2EDuration="10.87609252s" totalImagesPullingTime="7.59230294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:31.875484917 +0000 UTC m=+10.961032187" watchObservedRunningTime="2026-11-02 20:14:31.87609252 +0000 UTC m=+10.961639788"
Nov 02 20:14:32.298436 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.298393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mtm8t_66dfdd5f-6703-4846-bcb0-83f49098bc5f/konnectivity-agent/0.log" limit=1024
Nov 02 20:14:32.298436 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.298407    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9cldl_3e5313f6-f18b-493a-812a-8a6fccccaf0e/dns-node-resolver/0.log"
Nov 02 20:14:32.450085 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.450053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:32.450250 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:32.450168    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:32.450423 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.450406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:32.450506 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:32.450489    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:32.450563 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.450547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:32.450611 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:32.450599    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:32.554734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.554322    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="932b71526f77bca8d2a8fc0e639a2fa5f2525991a951e8d52be52211ead5b776" exitCode=0
Nov 02 20:14:32.554734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.554408    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"932b71526f77bca8d2a8fc0e639a2fa5f2525991a951e8d52be52211ead5b776"}
Nov 02 20:14:32.556178 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.556144    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdwv2" event={"ID":"86b9a022-00f8-447c-881d-a9b045ae1196","Type":"ContainerStarted","Data":"190da664debbb8b1c261b4489dbd30937a092897d7c7105f0f24c74505949456"}
Nov 02 20:14:32.778567 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:32.778513    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kdwv2" podStartSLOduration=3.208830672 podStartE2EDuration="10.778498935s" totalImagesPullingTime="7.569668263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:32.778387079 +0000 UTC m=+11.863934348" watchObservedRunningTime="2026-11-02 20:14:32.778498935 +0000 UTC m=+11.864046205"
Nov 02 20:14:33.054590 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:33.054516    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:33.055223 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:33.055185    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:14:33.064554 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:33.064538    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2nwz_4a3c02ba-eb10-4b76-a903-17c55cd5b011/node-ca/0.log"
Nov 02 20:14:33.560405 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:33.560367    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt" event={"ID":"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb","Type":"ContainerStarted","Data":"b49e76b84e5a4bc0c49b086750e0fb00f28ad049843816b55561cb18a80f5ff1"}
Nov 02 20:14:33.670698 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:33.670618    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt" podStartSLOduration=2.289376014 podStartE2EDuration="11.67059969s" totalImagesPullingTime="9.381223676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:33.670154835 +0000 UTC m=+12.755702106" watchObservedRunningTime="2026-11-02 20:14:33.67059969 +0000 UTC m=+12.756146963"
Nov 02 20:14:34.450183 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:34.449952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:34.450390 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:34.449967    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:34.450390 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:34.450269    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:34.450390 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:34.449975    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:34.450390 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:34.450376    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:34.450541 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:34.450471    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:34.565281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:34.565244    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="4c0b334f69ba7cc00260985e6e7c0e6ad368fde342639c3ea2761723712acbfb" exitCode=0
Nov 02 20:14:34.565926 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:34.565331    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"4c0b334f69ba7cc00260985e6e7c0e6ad368fde342639c3ea2761723712acbfb"}
Nov 02 20:14:36.450167 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:36.450090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:36.450167 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:36.450114    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:36.450909 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:36.450211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:36.450909 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:36.450224    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:36.450909 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:36.450351    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:36.450909 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:36.450476    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:36.571557 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:36.571523    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="c2ed6c61fdbcf757a5b22a8cc48dea928a002b8d91fb630895067461210d54db" exitCode=0
Nov 02 20:14:36.571557 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:36.571560    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"c2ed6c61fdbcf757a5b22a8cc48dea928a002b8d91fb630895067461210d54db"}
Nov 02 20:14:37.576322 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:37.576133    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:14:37.576911 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:37.576888    2574 generic.go:356] "Generic (PLEG): container finished" podID="dca97178-94dc-4858-9824-06c0c0e91c03" containerID="b41c488bf781c285b4be5b2785087b4fa3528568a561dc3874b41a0b8f6b638e" exitCode=1
Nov 02 20:14:37.576963 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:37.576932    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"852e9858620dae8a5e14f95eceff00d34def8488645a044a92611b67656bb36b"}
Nov 02 20:14:37.577001 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:37.576990    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerDied","Data":"b41c488bf781c285b4be5b2785087b4fa3528568a561dc3874b41a0b8f6b638e"}
Nov 02 20:14:37.577031 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:37.577024    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"a858a95750aad4bef3b659a4de66f2cb23d0afa6ccdb211a9af66ac1e7643f71"}
Nov 02 20:14:38.341618 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.341584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:38.341618 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.341623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:38.341862 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.341753    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:38.341862 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.341808    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:54.34179501 +0000 UTC m=+33.427342270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:38.341862 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.341753    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:38.341862 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.341839    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:54.34183302 +0000 UTC m=+33.427380281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:38.442865 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.442825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:38.443051 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.443015    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:38.443051 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.443035    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:38.443051 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.443060    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:38.443252 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.443118    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:14:54.443100097 +0000 UTC m=+33.528647348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:38.450120 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.450086    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:38.450120 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.450116    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:38.450298 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.450188    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:38.450298 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.450251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:38.450423 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.450357    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:38.450467 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:38.450436    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:38.583082 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.583055    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:14:38.583584 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.583508    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"91a87942d4095168d26b21fa0e446b1c931c23d85efb7c9141cf9d0f45a5210a"}
Nov 02 20:14:38.583641 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.583599    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"25aa2d5c91a2d2b1c4178ed602c1502620ce528bc544e84449c7c7f2911183dc"}
Nov 02 20:14:38.583726 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:38.583647    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"ad778a3db2ac73ae0001860b22bd75055d18830f5fac485c461130958c0a2580"}
Nov 02 20:14:39.589011 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:39.588978    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="a145288bba209dd25c7994cf3d69191cdc81cc3a78eb0e53d0a6836c8053fe86" exitCode=0
Nov 02 20:14:39.589574 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:39.589040    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"a145288bba209dd25c7994cf3d69191cdc81cc3a78eb0e53d0a6836c8053fe86"}
Nov 02 20:14:40.450193 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.449963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:40.450335 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.449983    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:40.450335 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:40.450230    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:40.450335 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.450023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:40.450335 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:40.450299    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:40.450501 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:40.450371    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:40.594548 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.594523    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:14:40.595001 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.594952    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"dd086c61849667102c715126178dae3eb853681738b1e088ae6f76263f6892ee"}
Nov 02 20:14:40.598233 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.598204    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="cab409ffe47dc79853669af88b9e7cab121267d41fc3d77b8287aa7e8a2322f6" exitCode=0
Nov 02 20:14:40.598348 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:40.598244    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerDied","Data":"cab409ffe47dc79853669af88b9e7cab121267d41fc3d77b8287aa7e8a2322f6"}
Nov 02 20:14:41.604589 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:41.604552    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpm95" event={"ID":"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d","Type":"ContainerStarted","Data":"d9c9546d5f7b613cbb26e0ee48cee46c5c076b9487068d60c7daf282de0db5e6"}
Nov 02 20:14:41.718955 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:41.718901    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dpm95" podStartSLOduration=7.594934906 podStartE2EDuration="19.718888209s" totalImagesPullingTime="12.123953303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:41.718314793 +0000 UTC m=+20.803862075" watchObservedRunningTime="2026-11-02 20:14:41.718888209 +0000 UTC m=+20.804435476"
Nov 02 20:14:42.449334 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.449303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:42.449512 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.449381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:42.449512 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.449497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:42.449512 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:42.449504    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:42.449637 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:42.449614    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:42.449755 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:42.449736    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:42.607870 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.607679    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bx89s" event={"ID":"23577fb2-f316-4afa-bc93-fb8cd1ff75a4","Type":"ContainerStarted","Data":"e70ebc97733b3472ae68e5f0d4e4e113fc8f8a6182167b402adc9589dde1c054"}
Nov 02 20:14:42.610909 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.610885    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:14:42.611285 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.611266    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"aaf0c54c329ced0ef96386ad7a101ddf459b7943672cf6fd1a5de9c1e41b7a2b"}
Nov 02 20:14:42.611744 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.611731    2574 scope.go:122] "RemoveContainer" containerID="b41c488bf781c285b4be5b2785087b4fa3528568a561dc3874b41a0b8f6b638e"
Nov 02 20:14:42.718571 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:42.718462    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bx89s" podStartSLOduration=1.22160501 podStartE2EDuration="20.71844858s" totalImagesPullingTime="19.49684357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-11-02 20:14:42.717914008 +0000 UTC m=+21.803461278" watchObservedRunningTime="2026-11-02 20:14:42.71844858 +0000 UTC m=+21.803995850"
Nov 02 20:14:43.616208 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.616180    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:14:43.616707 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.616485    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" event={"ID":"dca97178-94dc-4858-9824-06c0c0e91c03","Type":"ContainerStarted","Data":"fc3415ecc975f8f52ca7b31f92c86f9c59a11ef8562524d5a72761d0feed91dc"}
Nov 02 20:14:43.616777 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.616746    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:43.616833 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.616822    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:43.616884 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.616873    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:43.631609 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.631582    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:43.635047 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.635034    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:14:43.739594 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:43.739544    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5" podStartSLOduration=8.358779538 podStartE2EDuration="22.739531616s" totalImagesPullingTime="14.380752078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:14:43.738885129 +0000 UTC m=+22.824432397" watchObservedRunningTime="2026-11-02 20:14:43.739531616 +0000 UTC m=+22.825078884"
Nov 02 20:14:44.449931 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:44.449903    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:44.449931 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:44.449935    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:44.450123 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:44.449907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:44.450123 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:44.450020    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:44.450123 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:44.450087    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:44.450216 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:44.450177    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:46.449899 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:46.449867    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:46.449899 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:46.449890    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:46.450412 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:46.449867    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:46.450412 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:46.449968    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:46.450412 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:46.450051    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:46.450412 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:46.450099    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:48.449977 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:48.449947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:48.450490 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:48.449950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:48.450490 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:48.450056    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:48.450490 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:48.449950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:48.450490 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:48.450124    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:48.450490 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:48.450181    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:50.450049 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:50.450005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:50.450049 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:50.450010    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:50.450544 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:50.450060    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:50.450544 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:50.450137    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:50.450544 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:50.450213    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:50.450544 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:50.450303    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:52.449609 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:52.449574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:52.450076 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:52.449662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:52.450076 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:52.449770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:52.450076 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:52.449781    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:52.450076 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:52.449839    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:52.450076 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:52.449898    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:54.356756 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.356701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:54.356756 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.356767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:54.357249 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.356848    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:54.357249 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.356928    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs podName:bcc562af-9600-4878-99a4-ab8145971dc3 nodeName:}" failed. No retries permitted until 2026-11-02 20:15:26.356905703 +0000 UTC m=+65.442452963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs") pod "network-metrics-daemon-9lcqr" (UID: "bcc562af-9600-4878-99a4-ab8145971dc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 20:14:54.357249 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.356856    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:54.357249 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.356987    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret podName:be869f32-baad-41a8-bc8e-85f43ad15327 nodeName:}" failed. No retries permitted until 2026-11-02 20:15:26.356972845 +0000 UTC m=+65.442520094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret") pod "global-pull-secret-syncer-wzb8x" (UID: "be869f32-baad-41a8-bc8e-85f43ad15327") : object "kube-system"/"original-pull-secret" not registered
Nov 02 20:14:54.449244 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.449215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:54.449244 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.449215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:54.449462 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.449397    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:54.449462 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.449422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:54.449537 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.449516    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:54.449585 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.449570    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:54.457258 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:54.457225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:54.457388 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.457359    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 20:14:54.457388 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.457383    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 20:14:54.457484 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.457394    2574 projected.go:196] Error preparing data for projected volume kube-api-access-t945m for pod openshift-network-diagnostics/network-check-target-dng75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:54.457484 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:54.457470    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m podName:45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1 nodeName:}" failed. No retries permitted until 2026-11-02 20:15:26.457452243 +0000 UTC m=+65.542999505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t945m" (UniqueName: "kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m") pod "network-check-target-dng75" (UID: "45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 20:14:55.982105 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.982078    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dng75"]
Nov 02 20:14:55.982538 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.982189    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:55.982538 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:55.982295    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:55.984950 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.984932    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9lcqr"]
Nov 02 20:14:55.985042 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.985029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:55.985163 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:55.985146    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:55.986037 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.986015    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzb8x"]
Nov 02 20:14:55.986152 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:55.986111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:55.986233 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:55.986213    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:57.449117 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:57.449082    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:57.449117 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:57.449112    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:57.449567 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:57.449087    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:57.449567 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:57.449203    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:14:57.449567 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:57.449268    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:57.449567 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:57.449342    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:59.450351 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:59.450155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:14:59.450784 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:59.450155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:14:59.450784 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:59.450446    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzb8x" podUID="be869f32-baad-41a8-bc8e-85f43ad15327"
Nov 02 20:14:59.450784 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:14:59.450219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:14:59.450784 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:59.450499    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lcqr" podUID="bcc562af-9600-4878-99a4-ab8145971dc3"
Nov 02 20:14:59.450784 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:14:59.450568    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng75" podUID="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1"
Nov 02 20:15:00.139008 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.138978    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeReady"
Nov 02 20:15:00.139162 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.139124    2574 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 02 20:15:00.246967 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.246934    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4x878"]
Nov 02 20:15:00.280259 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.280184    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.293095 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.293071    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-94wh7"]
Nov 02 20:15:00.303585 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.303565    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.329879 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.329855    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 20:15:00.330071 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.330040    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82tkg\""
Nov 02 20:15:00.330234 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.330187    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 20:15:00.333362 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.333341    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9ktqv"]
Nov 02 20:15:00.349920 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.349887    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4x878"]
Nov 02 20:15:00.350066 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.350002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.394924 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.394894    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ktqv"]
Nov 02 20:15:00.400734 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400706    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.400840 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ssv\" (UniqueName: \"kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.400840 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.400840 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.400946 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400871    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrdlv\" (UniqueName: \"kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.400946 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.400946 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.401029 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.400964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.401029 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.401020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.409147 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.409122    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-94wh7"]
Nov 02 20:15:00.429937 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.429903    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 20:15:00.429937 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.429920    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 20:15:00.429937 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.429937    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 20:15:00.430150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.429957    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 20:15:00.430150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.430021    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 20:15:00.430150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.430047    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 20:15:00.430150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.430143    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 20:15:00.430263 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.430154    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d6nbh\""
Nov 02 20:15:00.430263 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.430211    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-74k7h\""
Nov 02 20:15:00.501658 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.501658 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ssv\" (UniqueName: \"kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdlv\" (UniqueName: \"kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.501957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pn6\" (UniqueName: \"kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502060    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502569 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502471    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.502569 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502507    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.502726 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.502707    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.505577 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.505554    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.505675 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.505556    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.567471 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.567406    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdlv\" (UniqueName: \"kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.567471 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.567446    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ssv\" (UniqueName: \"kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.602507 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.602474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.602703 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.602509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pn6\" (UniqueName: \"kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.604915 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.604895    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.616724 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.616679    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:00.663346 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.660651    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pn6\" (UniqueName: \"kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:00.664179 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.664153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:00.685468 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:00.685436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:01.099990 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.099957    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4x878"]
Nov 02 20:15:01.103878 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:01.103847    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90367f9_3755_4c66_80bc_e702b2e7b262.slice/crio-49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1 WatchSource:0}: Error finding container 49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1: Status 404 returned error can't find the container with id 49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1
Nov 02 20:15:01.112185 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.112158    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ktqv"]
Nov 02 20:15:01.115577 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.115554    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-94wh7"]
Nov 02 20:15:01.115677 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:01.115615    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39d9732_2759_45d2_b5ab_4d78379170ab.slice/crio-e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4 WatchSource:0}: Error finding container e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4: Status 404 returned error can't find the container with id e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4
Nov 02 20:15:01.119362 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:01.119304    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66aa142_2dd9_46ab_a304_5d96b9d01b38.slice/crio-49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872 WatchSource:0}: Error finding container 49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872: Status 404 returned error can't find the container with id 49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872
Nov 02 20:15:01.453107 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.453080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:01.453262 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.453241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:01.453359 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.453339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:01.503164 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503129    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 20:15:01.503164 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503131    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 20:15:01.503883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503435    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 20:15:01.503883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503539    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 20:15:01.503883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503555    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-4wc8w\""
Nov 02 20:15:01.503883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503568    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29pz\""
Nov 02 20:15:01.503883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.503619    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-7bq62\""
Nov 02 20:15:01.655972 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.655937    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94wh7" event={"ID":"f66aa142-2dd9-46ab-a304-5d96b9d01b38","Type":"ContainerStarted","Data":"43f37681177fbc39648ca6500f61591ff2b33cb206b10d38ec327758ad5ce200"}
Nov 02 20:15:01.656120 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.656002    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94wh7" event={"ID":"f66aa142-2dd9-46ab-a304-5d96b9d01b38","Type":"ContainerStarted","Data":"49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872"}
Nov 02 20:15:01.657030 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.657006    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ktqv" event={"ID":"d39d9732-2759-45d2-b5ab-4d78379170ab","Type":"ContainerStarted","Data":"e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4"}
Nov 02 20:15:01.658051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:01.658030    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x878" event={"ID":"f90367f9-3755-4c66-80bc-e702b2e7b262","Type":"ContainerStarted","Data":"49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1"}
Nov 02 20:15:03.316236 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:03.316182    2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/ac/acf2ee6813492863650ac663202ead5bde1272b2baf3b5ebd947195b4329fe92?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261102%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261102T201501Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=46e63ffc908e84987025dcd00eec1778419c1929e95b43ec1c0e8627d7527633&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793651401~hmac=6fe8f56981238e857bb384e7a3ab6154603e6ebbb244dd3bf4bd9d928c6d10c0\": read tcp 10.0.134.201:57758->23.46.228.109:443: read: connection reset by peer" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976"
Nov 02 20:15:03.316726 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:03.316398    2574 kuberuntime_manager.go:1707] "Unhandled Error" err="container dns start failed in pod dns-default-4x878_openshift-dns(f90367f9-3755-4c66-80bc-e702b2e7b262): ErrImagePull: unable to pull image: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/ac/acf2ee6813492863650ac663202ead5bde1272b2baf3b5ebd947195b4329fe92?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261102%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261102T201501Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=46e63ffc908e84987025dcd00eec1778419c1929e95b43ec1c0e8627d7527633&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793651401~hmac=6fe8f56981238e857bb384e7a3ab6154603e6ebbb244dd3bf4bd9d928c6d10c0\": read tcp 10.0.134.201:57758->23.46.228.109:443: read: connection reset by peer" logger="UnhandledError"
Nov 02 20:15:03.450827 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:03.450788    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns\" with ErrImagePull: \"unable to pull image: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/ac/acf2ee6813492863650ac663202ead5bde1272b2baf3b5ebd947195b4329fe92?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261102%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261102T201501Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=46e63ffc908e84987025dcd00eec1778419c1929e95b43ec1c0e8627d7527633&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793651401~hmac=6fe8f56981238e857bb384e7a3ab6154603e6ebbb244dd3bf4bd9d928c6d10c0\\\": read tcp 10.0.134.201:57758->23.46.228.109:443: read: connection reset by peer\"" pod="openshift-dns/dns-default-4x878" podUID="f90367f9-3755-4c66-80bc-e702b2e7b262"
Nov 02 20:15:03.664209 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:03.664168    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x878" event={"ID":"f90367f9-3755-4c66-80bc-e702b2e7b262","Type":"ContainerStarted","Data":"7cbd856cbe378e27368a70b316edee7697eaea7f1ae8d3cfb9f1d52595738f17"}
Nov 02 20:15:03.665964 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:03.665920    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976\\\": ErrImagePull: unable to pull image: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/ac/acf2ee6813492863650ac663202ead5bde1272b2baf3b5ebd947195b4329fe92?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261102%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261102T201501Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=46e63ffc908e84987025dcd00eec1778419c1929e95b43ec1c0e8627d7527633&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793651401~hmac=6fe8f56981238e857bb384e7a3ab6154603e6ebbb244dd3bf4bd9d928c6d10c0\\\": read tcp 10.0.134.201:57758->23.46.228.109:443: read: connection reset by peer\"" pod="openshift-dns/dns-default-4x878" podUID="f90367f9-3755-4c66-80bc-e702b2e7b262"
Nov 02 20:15:03.666265 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:03.666239    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94wh7" event={"ID":"f66aa142-2dd9-46ab-a304-5d96b9d01b38","Type":"ContainerStarted","Data":"12f279efb1b22ae28ded01e343d50f0196c2f4de2fb7d7fc92ba2b5562290ac2"}
Nov 02 20:15:04.627863 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.627821    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"]
Nov 02 20:15:04.630146 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.630121    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.669856 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:04.669799    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4023dcf758240517ab8f3060eca20eae58955d7fa97cbcff59e116b7ed8cb976\\\": ErrImagePull: unable to pull image: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/ac/acf2ee6813492863650ac663202ead5bde1272b2baf3b5ebd947195b4329fe92?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261102%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261102T201501Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=46e63ffc908e84987025dcd00eec1778419c1929e95b43ec1c0e8627d7527633&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793651401~hmac=6fe8f56981238e857bb384e7a3ab6154603e6ebbb244dd3bf4bd9d928c6d10c0\\\": read tcp 10.0.134.201:57758->23.46.228.109:443: read: connection reset by peer\"" pod="openshift-dns/dns-default-4x878" podUID="f90367f9-3755-4c66-80bc-e702b2e7b262"
Nov 02 20:15:04.725320 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725289    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 20:15:04.725320 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725299    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c5lbk\""
Nov 02 20:15:04.725320 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725299    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 02 20:15:04.725558 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725318    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 20:15:04.725558 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725425    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 20:15:04.725558 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.725499    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 02 20:15:04.734723 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.734696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.734834 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.734735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhpk\" (UniqueName: \"kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.734884 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.734867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.734913 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.734892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.772576 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.772548    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"]
Nov 02 20:15:04.835357 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.835322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.835357 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.835356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.835540 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.835404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.835540 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.835463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhpk\" (UniqueName: \"kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.836194 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.836145    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.841095 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.841064    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.841200 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.841064    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.893416 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.893385    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhpk\" (UniqueName: \"kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:04.943364 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:04.943326    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:05.302601 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:05.302517    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"]
Nov 02 20:15:05.340053 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:05.340019    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a30bcee_6023_42e4_b8e5_334a8005aa92.slice/crio-e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f WatchSource:0}: Error finding container e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f: Status 404 returned error can't find the container with id e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f
Nov 02 20:15:05.672108 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:05.672070    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx" event={"ID":"3a30bcee-6023-42e4-b8e5-334a8005aa92","Type":"ContainerStarted","Data":"e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f"}
Nov 02 20:15:07.357236 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.357204    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:15:07.359658 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.359642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.408718 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.408672    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 02 20:15:07.454973 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.454934    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 02 20:15:07.454973 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.454935    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455103    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455180    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455143    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nm4xn\""
Nov 02 20:15:07.455220 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455186    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455242    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455488 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.455707 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.455491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.549161 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.549132    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 02 20:15:07.549545 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.549525    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:15:07.556663 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.556739 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.556739 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.556904 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.556958 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.556958 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557052 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557052 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.556992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557501 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.557475    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557607 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.557479    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557607 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.557482    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.557871 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.557853    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.558139 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.558122    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.559864 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.559843    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.559984 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.559966    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.614566 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.614500    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:07.670408 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:07.670370    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:08.037758 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:08.037668    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:15:08.067072 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:08.067038    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284a1d91_f3b7_4bd2_8a2a_c1f3780f4e28.slice/crio-0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78 WatchSource:0}: Error finding container 0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78: Status 404 returned error can't find the container with id 0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78
Nov 02 20:15:08.683954 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:08.681878    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d9fc779-6kjqm" event={"ID":"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28","Type":"ContainerStarted","Data":"0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78"}
Nov 02 20:15:08.684367 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:08.684207    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx" event={"ID":"3a30bcee-6023-42e4-b8e5-334a8005aa92","Type":"ContainerStarted","Data":"6779a35670c8df6c9b607d0a48b07e8c8c5f23524d060fe96eb71c222e005603"}
Nov 02 20:15:08.684367 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:08.684266    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx" event={"ID":"3a30bcee-6023-42e4-b8e5-334a8005aa92","Type":"ContainerStarted","Data":"01e14913e7064f4f5549a309ba8ef31437f984c78a438f5081a525ba47b75ef8"}
Nov 02 20:15:08.795668 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:08.795608    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx" podStartSLOduration=1.882292859 podStartE2EDuration="4.795591059s" totalImagesPullingTime="2.9132982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:08.795244122 +0000 UTC m=+47.880791401" watchObservedRunningTime="2026-11-02 20:15:08.795591059 +0000 UTC m=+47.881138328"
Nov 02 20:15:09.688491 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:09.688443    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ktqv" event={"ID":"d39d9732-2759-45d2-b5ab-4d78379170ab","Type":"ContainerStarted","Data":"1aa7c7672494a618aa594a9ca7f5ba01da54066fbd2d77d46a2154bca7dc890b"}
Nov 02 20:15:09.797239 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:09.797184    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9ktqv" podStartSLOduration=1.922413712 podStartE2EDuration="9.797170085s" totalImagesPullingTime="7.874756373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:09.796693673 +0000 UTC m=+48.882240933" watchObservedRunningTime="2026-11-02 20:15:09.797170085 +0000 UTC m=+48.882717352"
Nov 02 20:15:11.698626 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:11.698573    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94wh7" event={"ID":"f66aa142-2dd9-46ab-a304-5d96b9d01b38","Type":"ContainerStarted","Data":"f5d67792ad23a18999cb4a8931a6759058bb81cb615f605ddaff7b7d55ae3f7b"}
Nov 02 20:15:11.809453 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:11.809377    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-94wh7" podStartSLOduration=2.408205827 podStartE2EDuration="11.809357685s" totalImagesPullingTime="9.401151858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 20:15:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:11.808821357 +0000 UTC m=+50.894368626" watchObservedRunningTime="2026-11-02 20:15:11.809357685 +0000 UTC m=+50.894904953"
Nov 02 20:15:12.260440 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.260349    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g7q92"]
Nov 02 20:15:12.268730 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.268701    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.317527 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.317491    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 20:15:12.363446 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.363413    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 20:15:12.363446 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.363437    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 20:15:12.363662 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.363455    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bvgts\""
Nov 02 20:15:12.398389 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398389 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398606 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398669 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398669 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398784 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398821 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398821 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.398926 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.398827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9tdn\" (UniqueName: \"kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499662 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499816 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499816 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499816 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499816 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499775    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.499816 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tdn\" (UniqueName: \"kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499773    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.499966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.500035    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500150 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.500048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500565 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.500279    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500565 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.500352    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.500669 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.500646    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.502249 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.502229    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.502326 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.502280    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.557266 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.557240    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tdn\" (UniqueName: \"kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.582494 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.582458    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:12.591607 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:12.591572    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce01914_1334_4916_95b5_557392e76335.slice/crio-dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d WatchSource:0}: Error finding container dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d: Status 404 returned error can't find the container with id dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d
Nov 02 20:15:12.703681 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.703639    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7q92" event={"ID":"3ce01914-1334-4916-95b5-557392e76335","Type":"ContainerStarted","Data":"dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d"}
Nov 02 20:15:12.705558 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.705524    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d9fc779-6kjqm" event={"ID":"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28","Type":"ContainerStarted","Data":"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"}
Nov 02 20:15:12.819970 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:12.819868    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-665d9fc779-6kjqm" podStartSLOduration=1.418558871 podStartE2EDuration="5.819854371s" totalImagesPullingTime="4.4012955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:12.819383467 +0000 UTC m=+51.904930737" watchObservedRunningTime="2026-11-02 20:15:12.819854371 +0000 UTC m=+51.905401706"
Nov 02 20:15:14.433920 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.433883    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:15:14.436681 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.436662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.485874 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.485844    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 02 20:15:14.485874 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.485844    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 02 20:15:14.486051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.485844    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 02 20:15:14.486051 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.485870    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 02 20:15:14.531693 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.531663    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 02 20:15:14.531848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.531660    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 02 20:15:14.531848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.531729    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7zgsp\""
Nov 02 20:15:14.531848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.531725    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 02 20:15:14.531848 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.531673    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 02 20:15:14.579143 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.579113    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 02 20:15:14.581668 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.581638    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:15:14.616637 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616775 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616815 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616858 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616887 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616926 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616960 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.616994 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.616974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.617027 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.617007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.617067 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.617035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.617153 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.617132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.617208 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.617174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.617251 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.617203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.714146 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.714061    2574 generic.go:356] "Generic (PLEG): container finished" podID="3ce01914-1334-4916-95b5-557392e76335" containerID="7566f5faf553bbba62616fcb4fafd2a340fb6727d414dd955d76f0f14c831d12" exitCode=0
Nov 02 20:15:14.714280 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.714138    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7q92" event={"ID":"3ce01914-1334-4916-95b5-557392e76335","Type":"ContainerDied","Data":"7566f5faf553bbba62616fcb4fafd2a340fb6727d414dd955d76f0f14c831d12"}
Nov 02 20:15:14.717984 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.717962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.717994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718084 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718293 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718108    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718293 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718149    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718293 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718293 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.718293 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.718235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.719498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.719561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.719882    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.719997    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720281 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.720232    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.720752 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.720730    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.721173 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.721147    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.721681 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.721654    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.721751 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.721674    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.722671 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.722634    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.722866 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.722837    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.723085 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.723070    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.723553 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.723534    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.725111 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.725095    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:14.779761 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:14.779739    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:15.053186 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.053106    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:15.517336 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.517302    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:15:15.567303 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:15.567275    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06defd7_ffcb_4a3b_8567_82c85286ec73.slice/crio-5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b WatchSource:0}: Error finding container 5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b: Status 404 returned error can't find the container with id 5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b
Nov 02 20:15:15.630306 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.630280    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:15.719503 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.719466    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7q92" event={"ID":"3ce01914-1334-4916-95b5-557392e76335","Type":"ContainerStarted","Data":"37c06123a1e5c36661ef0c1aeddb0cd231414887072a7f1598089780d84c95cf"}
Nov 02 20:15:15.719671 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.719536    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7q92" event={"ID":"3ce01914-1334-4916-95b5-557392e76335","Type":"ContainerStarted","Data":"6e7db1d4a48776b624a09ea4b8a6ba60f37dabd18039b85addc4ddc0518db092"}
Nov 02 20:15:15.720753 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.720722    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b"}
Nov 02 20:15:15.919776 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:15.919724    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g7q92" podStartSLOduration=2.406915472 podStartE2EDuration="3.919710161s" totalImagesPullingTime="1.44861919s" totalInitContainerRuntime="64.175499ms" isStatefulPod=true podCreationTimestamp="2026-11-02 20:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:15.918432128 +0000 UTC m=+55.003979399" watchObservedRunningTime="2026-11-02 20:15:15.919710161 +0000 UTC m=+55.005257428"
Nov 02 20:15:17.332042 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.332009    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"]
Nov 02 20:15:17.334104 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.334088    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343549 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57xjf\" (UniqueName: \"kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343549 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343743 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343649    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343743 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343831 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343831 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.343927 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.343845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.383535 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.383513    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 02 20:15:17.429768 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.429736    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 02 20:15:17.429907 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.429780    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 20:15:17.429907 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.429798    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cmv8mitksohj6\""
Nov 02 20:15:17.429907 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.429823    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 02 20:15:17.429995 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.429980    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qlcqs\""
Nov 02 20:15:17.430893 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.430875    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"]
Nov 02 20:15:17.444348 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57xjf\" (UniqueName: \"kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444425 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444425 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444479 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444479 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444563 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444563 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.444962 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.444940    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.445191 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.445173    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.445837 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.445810    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.447067 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.447047    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.447226 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.447209    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.447330 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.447273    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.501251 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.501223    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57xjf\" (UniqueName: \"kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.648036 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.648000    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:17.671052 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.671024    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:17.671330 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.671303    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:17.677035 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.677013    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:17.729402 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.729363    2574 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61" exitCode=0
Nov 02 20:15:17.729528 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.729459    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"}
Nov 02 20:15:17.733315 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:17.733295    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:18.064407 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:18.064333    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"]
Nov 02 20:15:18.067785 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:18.067753    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a912dbc_638d_499d_b597_b89194a13603.slice/crio-0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2 WatchSource:0}: Error finding container 0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2: Status 404 returned error can't find the container with id 0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2
Nov 02 20:15:18.735093 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:18.735054    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz" event={"ID":"5a912dbc-638d-499d-b597-b89194a13603","Type":"ContainerStarted","Data":"0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2"}
Nov 02 20:15:20.746912 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.746832    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"}
Nov 02 20:15:20.747337 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.746951    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"}
Nov 02 20:15:20.747337 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.746994    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"}
Nov 02 20:15:20.747337 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.747028    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"}
Nov 02 20:15:20.747337 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.747065    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"}
Nov 02 20:15:20.748436 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.748410    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz" event={"ID":"5a912dbc-638d-499d-b597-b89194a13603","Type":"ContainerStarted","Data":"c32167643e09f601471ee999c725fb5365f90b6d5cef35e3385a24c9d5aaf5b8"}
Nov 02 20:15:20.867350 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:20.867302    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz" podStartSLOduration=2.071558136 podStartE2EDuration="3.867289617s" totalImagesPullingTime="1.795731481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:20.866413583 +0000 UTC m=+59.951960853" watchObservedRunningTime="2026-11-02 20:15:20.867289617 +0000 UTC m=+59.952836886"
Nov 02 20:15:21.756160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:21.756124    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerStarted","Data":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"}
Nov 02 20:15:21.971570 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:21.971524    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.778213186 podStartE2EDuration="7.971510093s" totalImagesPullingTime="5.181541047s" totalInitContainerRuntime="11.75586ms" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:21.924495856 +0000 UTC m=+61.010043165" watchObservedRunningTime="2026-11-02 20:15:21.971510093 +0000 UTC m=+61.057057362"
Nov 02 20:15:22.761786 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:22.761752    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x878" event={"ID":"f90367f9-3755-4c66-80bc-e702b2e7b262","Type":"ContainerStarted","Data":"6f02ffde43445352e6aa5fcf44eb168994c47503c446e1c8356e80159e1d1388"}
Nov 02 20:15:22.872544 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:22.872493    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-4x878" podStartSLOduration=18.220133033 podStartE2EDuration="22.872477174s" totalImagesPullingTime="4.652344141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:22.871469767 +0000 UTC m=+61.957017035" watchObservedRunningTime="2026-11-02 20:15:22.872477174 +0000 UTC m=+61.958024433"
Nov 02 20:15:24.415365 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.415326    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:15:24.417637 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.417614    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.478350 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.478315    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:15:24.503706 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.503658    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.503843 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.503712    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.503843 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.503816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.503936 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.503850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.504005 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.503986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.504046 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.504032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.504076 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.504053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.504116 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.504079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.604932 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.604897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.604932 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.604935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.604961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.604991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605160 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605677 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605636    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605808 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605792    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605934 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605913    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.605984 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.605954    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.606086 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.606068    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.607676 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.607655    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.607797 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.607781    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.662390 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.662354    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:24.728382 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:24.728288    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:25.095207 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:25.095120    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:15:25.098865 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:25.098834    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7329985d_9aae_4933_972a_6f854d133528.slice/crio-8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433 WatchSource:0}: Error finding container 8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433: Status 404 returned error can't find the container with id 8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433
Nov 02 20:15:25.762880 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:25.762840    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:25.772446 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:25.772414    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f757d487-2j98h" event={"ID":"7329985d-9aae-4933-972a-6f854d133528","Type":"ContainerStarted","Data":"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"}
Nov 02 20:15:25.772584 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:25.772466    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f757d487-2j98h" event={"ID":"7329985d-9aae-4933-972a-6f854d133528","Type":"ContainerStarted","Data":"8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433"}
Nov 02 20:15:25.883663 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:25.883607    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5f757d487-2j98h" podStartSLOduration=1.883592111 podStartE2EDuration="1.883592111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:25.882438085 +0000 UTC m=+64.967985337" watchObservedRunningTime="2026-11-02 20:15:25.883592111 +0000 UTC m=+64.969139378"
Nov 02 20:15:26.421952 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.421913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:26.421952 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.421952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:26.470207 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.470176    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 20:15:26.474559 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.474531    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:26.516643 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.516614    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 20:15:26.523078 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.523051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:26.524910 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.524890    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:26.571157 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.571128    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 20:15:26.622026 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.621996    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 20:15:26.626651 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.626632    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:26.742451 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.742379    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29pz\""
Nov 02 20:15:26.744456 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.744438    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:26.748961 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.748946    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-7bq62\""
Nov 02 20:15:26.751121 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.751103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:26.754017 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.753998    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-4wc8w\""
Nov 02 20:15:26.756090 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:26.756069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:27.163992 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.163796    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzb8x"]
Nov 02 20:15:27.166751 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:27.166718    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe869f32_baad_41a8_bc8e_85f43ad15327.slice/crio-88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656 WatchSource:0}: Error finding container 88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656: Status 404 returned error can't find the container with id 88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656
Nov 02 20:15:27.211437 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.211408    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dng75"]
Nov 02 20:15:27.212378 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.212358    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9lcqr"]
Nov 02 20:15:27.216781 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:27.215758    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eb4e5c_c7f6_41c8_a710_af60ec0dc3e1.slice/crio-d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6 WatchSource:0}: Error finding container d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6: Status 404 returned error can't find the container with id d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6
Nov 02 20:15:27.217287 ip-10-0-134-201 kubenswrapper[2574]: W1102 20:15:27.217249    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc562af_9600_4878_99a4_ab8145971dc3.slice/crio-a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c WatchSource:0}: Error finding container a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c: Status 404 returned error can't find the container with id a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c
Nov 02 20:15:27.780659 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.780623    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dng75" event={"ID":"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1","Type":"ContainerStarted","Data":"d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6"}
Nov 02 20:15:27.781791 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.781762    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wzb8x" event={"ID":"be869f32-baad-41a8-bc8e-85f43ad15327","Type":"ContainerStarted","Data":"88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656"}
Nov 02 20:15:27.782883 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:27.782860    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lcqr" event={"ID":"bcc562af-9600-4878-99a4-ab8145971dc3","Type":"ContainerStarted","Data":"a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c"}
Nov 02 20:15:29.804033 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:29.803999    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lcqr" event={"ID":"bcc562af-9600-4878-99a4-ab8145971dc3","Type":"ContainerStarted","Data":"070d3d2c30fe5dc778b332e3b9946e9fff2152dbb96585b59b1c171cb1cd62ca"}
Nov 02 20:15:29.804481 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:29.804052    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lcqr" event={"ID":"bcc562af-9600-4878-99a4-ab8145971dc3","Type":"ContainerStarted","Data":"67d3f567258a4021d0061b4d3ab52a02dc750a3d9d38731e8d213f91861dc48e"}
Nov 02 20:15:29.913814 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:29.912293    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9lcqr" podStartSLOduration=66.361817819 podStartE2EDuration="1m7.912275303s" totalImagesPullingTime="1.550457484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:29.912043275 +0000 UTC m=+68.997590559" watchObservedRunningTime="2026-11-02 20:15:29.912275303 +0000 UTC m=+68.997822571"
Nov 02 20:15:30.702277 ip-10-0-134-201 kubenswrapper[2574]: E1102 20:15:30.702234    2574 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:15:31.765395 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:31.765357    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:31.817041 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:31.817007    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dng75" event={"ID":"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1","Type":"ContainerStarted","Data":"06d1b82f486a8cf79de6343359140cdcf5735cf72c5296440886e49ca21b1bbd"}
Nov 02 20:15:31.817209 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:31.817123    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:31.984888 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:31.983463    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dng75" podStartSLOduration=66.335444075 podStartE2EDuration="1m9.983444117s" totalImagesPullingTime="3.648000042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:15:31.982875679 +0000 UTC m=+71.068422959" watchObservedRunningTime="2026-11-02 20:15:31.983444117 +0000 UTC m=+71.068991393"
Nov 02 20:15:33.005767 ip-10-0-134-201 kubenswrapper[2574]: I1102 20:15:33.005629    2574 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 20:15:33.005845 ip-10-0-134-201 systemd[1]: Stopping Kubernetes Kubelet...
Nov 02 20:15:33.014309 ip-10-0-134-201 systemd[1]: kubelet.service: Deactivated successfully.
Nov 02 20:15:33.014476 ip-10-0-134-201 systemd[1]: Stopped Kubernetes Kubelet.
Nov 02 20:15:33.014521 ip-10-0-134-201 systemd[1]: kubelet.service: Consumed 4.033s CPU time.
Nov 02 20:15:33.031241 ip-10-0-134-201 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 20:15:33.091355 ip-10-0-134-201 kubenswrapper[5457]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:15:33.091355 ip-10-0-134-201 kubenswrapper[5457]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 20:15:33.091355 ip-10-0-134-201 kubenswrapper[5457]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:15:33.091355 ip-10-0-134-201 kubenswrapper[5457]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093253    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093336    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093340    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093343    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093346    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.093340 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093349    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093359    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093362    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093366    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093368    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093371    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093374    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093376    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093379    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093381    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093384    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093394    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093397    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093400    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093403    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093406    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093409    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093411    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093414    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093417    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.093587 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093419    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093422    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093424    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093445    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093450    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093455    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093458    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093462    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093464    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093467    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093470    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093473    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093476    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093478    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093482    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093484    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093487    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093490    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093493    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.094107 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093495    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093498    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093501    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093503    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093506    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093508    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093511    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093514    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093516    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093519    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093521    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093524    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093526    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093532    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093536    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093540    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093542    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093546    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093548    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093551    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.094572 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093553    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093556    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093559    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093562    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093564    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093567    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093569    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093572    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093575    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093578    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093580    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093583    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093586    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093588    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093591    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093594    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093596    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093599    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093602    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093604    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.095082 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093607    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093610    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093613    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093615    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093618    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093621    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093623    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093626    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093629    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093633    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093636    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093638    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093641    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093643    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093646    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093649    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093651    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093655    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093658    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093660    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.095641 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093663    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.093666    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094474    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094483    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094487    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094491    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094494    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094497    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094500    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094502    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094505    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094508    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094511    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094514    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094517    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094520    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094522    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094525    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094528    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.096160 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094531    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094534    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094536    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094539    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094542    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094544    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094547    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094550    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094552    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094554    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094557    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094560    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094562    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094565    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094567    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094571    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094573    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094576    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094579    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094581    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.096625 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094584    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094587    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094590    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094592    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094595    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094597    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094600    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094603    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094606    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094609    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094611    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094614    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094617    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094620    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094622    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094625    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094627    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094630    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094633    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.097145 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094637    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094640    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094643    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094646    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094650    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094653    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094669    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094672    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094674    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094678    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094681    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094698    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094701    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094703    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094706    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094708    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094711    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094713    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094716    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094719    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.097646 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094723    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094725    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094728    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094731    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094734    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094736    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094739    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094741    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094744    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094746    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094749    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094752    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094754    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094757    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094759    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094763    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094765    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094768    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094771    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094773    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.098201 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094776    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094778    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094781    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094784    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094786    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094789    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094791    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094794    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094797    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.094799    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095294    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095299    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095302    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095305    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095308    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095311    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095313    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095316    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095318    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095321    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.098835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095324    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095327    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095329    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095331    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095334    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095337    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095340    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095342    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095345    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095348    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095351    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095354    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095356    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095359    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095362    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095365    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095367    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095370    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095373    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095375    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.099341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095378    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095381    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095384    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095386    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095390    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095392    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095395    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095397    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095400    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095402    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095405    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095407    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095410    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095412    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095415    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095417    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095420    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095422    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095426    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.099867 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095431    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095435    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095438    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095441    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095443    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095446    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095448    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095451    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095453    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095456    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095459    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095461    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095467    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095471    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095475    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095479    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095482    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095486    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095490    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095493    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.100302 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095497    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095502    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095506    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095509    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095513    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095517    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095521    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095525    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095528    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095532    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095536    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095540    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095544    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095547    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095551    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095555    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095559    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095563    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095567    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.100788 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095570    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095574    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095579    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095583    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095588    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095596    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095600    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095604    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095608    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095613    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095617    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095621    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095625    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095628    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095632    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095638    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095642    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.095645    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095760    5457 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095768    5457 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095775    5457 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 20:15:33.101418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095779    5457 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095783    5457 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095787    5457 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095791    5457 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095795    5457 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095799    5457 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095802    5457 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095805    5457 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095809    5457 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095812    5457 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095815    5457 flags.go:64] FLAG: --cgroup-root=""
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095818    5457 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095821    5457 flags.go:64] FLAG: --client-ca-file=""
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095824    5457 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095827    5457 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095831    5457 flags.go:64] FLAG: --cluster-domain=""
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095836    5457 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095839    5457 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095842    5457 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095845    5457 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095851    5457 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095854    5457 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095858    5457 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 20:15:33.102440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095862    5457 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095865    5457 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095868    5457 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095871    5457 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095874    5457 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095877    5457 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095881    5457 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095885    5457 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095887    5457 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095890    5457 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095893    5457 flags.go:64] FLAG: --enable-server="true"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095896    5457 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095901    5457 flags.go:64] FLAG: --event-burst="100"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095904    5457 flags.go:64] FLAG: --event-qps="50"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095907    5457 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095910    5457 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095913    5457 flags.go:64] FLAG: --eviction-hard=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095918    5457 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095921    5457 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095924    5457 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095927    5457 flags.go:64] FLAG: --eviction-soft=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095930    5457 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095933    5457 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095936    5457 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095939    5457 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 20:15:33.103044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095944    5457 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095947    5457 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095950    5457 flags.go:64] FLAG: --feature-gates=""
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095955    5457 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095960    5457 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095963    5457 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095967    5457 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095970    5457 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095973    5457 flags.go:64] FLAG: --help="false"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095976    5457 flags.go:64] FLAG: --hostname-override="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095979    5457 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095982    5457 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095985    5457 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095989    5457 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095992    5457 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095995    5457 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.095998    5457 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096001    5457 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096004    5457 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096007    5457 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096010    5457 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096013    5457 flags.go:64] FLAG: --kube-reserved=""
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096016    5457 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096019    5457 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 20:15:33.103846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096022    5457 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096025    5457 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096028    5457 flags.go:64] FLAG: --lock-file=""
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096031    5457 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096034    5457 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096036    5457 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096042    5457 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096045    5457 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096050    5457 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096053    5457 flags.go:64] FLAG: --logging-format="text"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096056    5457 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096060    5457 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096064    5457 flags.go:64] FLAG: --manifest-url=""
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096067    5457 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096071    5457 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096075    5457 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096078    5457 flags.go:64] FLAG: --max-pods="110"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096081    5457 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096085    5457 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096088    5457 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096091    5457 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096094    5457 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096097    5457 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096100    5457 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096108    5457 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 20:15:33.104475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096111    5457 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096114    5457 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096117    5457 flags.go:64] FLAG: --pod-cidr=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096120    5457 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096123    5457 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096126    5457 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096129    5457 flags.go:64] FLAG: --port="10250"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096132    5457 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096135    5457 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-03d80495a777bac00"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096139    5457 flags.go:64] FLAG: --qos-reserved=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096142    5457 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096145    5457 flags.go:64] FLAG: --register-node="true"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096148    5457 flags.go:64] FLAG: --register-with-taints=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096151    5457 flags.go:64] FLAG: --registry-burst="10"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096154    5457 flags.go:64] FLAG: --registry-qps="5"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096159    5457 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096163    5457 flags.go:64] FLAG: --reserved-memory=""
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096168    5457 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096171    5457 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096176    5457 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096179    5457 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096182    5457 flags.go:64] FLAG: --runonce="false"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096185    5457 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096188    5457 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096191    5457 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096194    5457 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096197    5457 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 20:15:33.105106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096200    5457 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096203    5457 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096206    5457 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096209    5457 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096212    5457 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096215    5457 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096217    5457 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096220    5457 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096223    5457 flags.go:64] FLAG: --system-cgroups=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096226    5457 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096232    5457 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096235    5457 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096239    5457 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096243    5457 flags.go:64] FLAG: --tls-min-version=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096246    5457 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096249    5457 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096251    5457 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096254    5457 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096257    5457 flags.go:64] FLAG: --v="2"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096262    5457 flags.go:64] FLAG: --version="false"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096267    5457 flags.go:64] FLAG: --vmodule=""
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096271    5457 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096275    5457 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096404    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096410    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.105983 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096413    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096416    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096418    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096421    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096423    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096426    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096429    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096431    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096434    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096437    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096439    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096442    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096444    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096447    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096449    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096452    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096454    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096457    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096459    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.106881 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096462    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096465    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096467    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096470    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096472    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096475    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096477    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096480    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096482    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096485    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096489    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096493    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096497    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096500    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096503    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096505    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096508    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096511    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096513    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.107407 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096516    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096519    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096521    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096524    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096527    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096529    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096532    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096534    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096537    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096540    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096542    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096545    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096547    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096550    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096552    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096555    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096558    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096560    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096563    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.108274 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096565    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096568    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096570    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096573    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096575    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096578    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096582    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096585    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096588    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096590    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096593    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096596    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096598    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096601    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096603    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096606    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096608    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096611    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096614    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096616    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.108745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096619    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096622    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096624    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096627    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096630    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096633    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096635    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096638    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096640    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096643    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096646    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096648    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096651    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096654    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096657    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096661    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096664    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096667    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096671    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.109312 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096675    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096677    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096680    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096695    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096698    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096701    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096703    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096706    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.096733    5457 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096771    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096776    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096779    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096782    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096784    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096787    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.109940 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096790    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096792    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096796    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096798    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096801    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096803    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096806    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096808    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096811    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096813    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096816    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096818    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096821    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096824    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096826    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096829    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096831    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096835    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096839    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096841    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.110415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096844    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096846    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096849    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096851    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096854    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096856    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096860    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096862    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096865    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096867    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096870    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096872    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096875    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096879    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096882    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096885    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096888    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096890    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096893    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.111126 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096895    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096898    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096900    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096903    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096905    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096908    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096910    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096913    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096915    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096918    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096922    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096924    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096931    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096933    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096936    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096939    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096941    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096944    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096946    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.111593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096950    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096953    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096955    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096958    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096960    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096963    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096965    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096968    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096970    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096973    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096976    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096980    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096983    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096985    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096988    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096990    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096993    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096995    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.096998    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097001    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.112113 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097003    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097006    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097008    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097013    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097016    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097018    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097021    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097024    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097027    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097029    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097032    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097035    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097038    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097041    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097043    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097046    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097048    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097052    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097055    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097058    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.112597 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097061    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.097064    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.100717    5457 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.100734    5457 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.100751    5457 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.100756    5457 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100810    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100815    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100819    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100823    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100826    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100829    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100831    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100835    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100840    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100842    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100845    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100848    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100851    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.113081 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100854    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100857    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100860    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100862    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100865    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100868    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100871    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100874    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100877    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100880    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100883    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100885    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100888    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100891    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100894    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100896    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100932    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100969    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100975    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.113552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.100979    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101008    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101013    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101018    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101022    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101027    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101032    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101037    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101042    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101047    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101051    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101061    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101065    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101069    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101074    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101079    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101084    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101088    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101092    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.114026 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101097    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101101    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101105    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101110    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101114    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101123    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101128    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101142    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101147    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101151    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101155    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101161    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101165    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101169    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101174    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101178    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101182    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101191    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101196    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101200    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.114484 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101204    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101208    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101212    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101217    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101221    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101227    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101233    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101239    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101243    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101248    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101257    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101261    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101265    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101270    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101274    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101278    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101282    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101286    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101290    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.114984 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101295    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101299    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101303    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101311    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101316    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101321    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101325    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101330    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101334    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101338    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101342    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101346    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101351    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101355    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101359    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101363    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.115430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.101419    5457 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101921    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101931    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.101937    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102002    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102036    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102147    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102153    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102159    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102163    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102166    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102169    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102172    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102174    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102179    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102182    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102185    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102188    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102190    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102193    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.115892 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102196    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102198    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102202    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102204    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102208    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102210    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102213    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102216    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102219    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102222    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102224    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102227    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102230    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102232    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102235    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102237    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102241    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102244    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102248    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102251    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.116376 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102254    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102257    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102260    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102262    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102265    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102268    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102271    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102273    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102276    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102279    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102282    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102285    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102288    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102290    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102293    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102296    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102299    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102302    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102305    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.116894 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102308    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102310    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102313    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102316    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102318    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102321    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102323    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102328    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102333    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102339    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102343    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102345    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102348    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102352    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102354    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102357    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102360    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102363    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102366    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.117341 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102368    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102371    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102373    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102376    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102379    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102381    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102384    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102386    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102389    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102392    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102394    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102397    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102400    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102402    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102405    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102407    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102410    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102412    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102416    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102419    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.117835 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102423    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102426    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102431    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102434    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102436    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102439    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102442    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102445    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102448    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.102485    5457 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102525    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102529    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102533    5457 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102536    5457 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102539    5457 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102542    5457 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 20:15:33.118338 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102545    5457 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102547    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102550    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102553    5457 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102555    5457 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102558    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102561    5457 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102564    5457 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102566    5457 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102569    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102572    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102575    5457 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102578    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102580    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102583    5457 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102585    5457 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102588    5457 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102591    5457 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102595    5457 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 20:15:33.118743 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102597    5457 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102602    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102604    5457 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102607    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102610    5457 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102613    5457 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102615    5457 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102619    5457 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102624    5457 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102627    5457 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102630    5457 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102633    5457 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102635    5457 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102638    5457 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102641    5457 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102643    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102646    5457 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102648    5457 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102651    5457 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 20:15:33.119234 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102654    5457 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102656    5457 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102659    5457 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102662    5457 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102664    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102667    5457 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102682    5457 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102707    5457 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102709    5457 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102712    5457 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102714    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102717    5457 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102721    5457 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102724    5457 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102728    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102730    5457 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102733    5457 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102736    5457 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102740    5457 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102744    5457 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 20:15:33.120002 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102748    5457 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102752    5457 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102755    5457 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102757    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102760    5457 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102762    5457 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102765    5457 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102767    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102770    5457 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102773    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102775    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102778    5457 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102780    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102783    5457 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102786    5457 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102788    5457 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102791    5457 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102794    5457 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102796    5457 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102799    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 20:15:33.120786 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102801    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102804    5457 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102806    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102809    5457 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102812    5457 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102815    5457 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102820    5457 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102822    5457 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102825    5457 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102828    5457 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102830    5457 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102833    5457 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102836    5457 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102839    5457 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102841    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102845    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102848    5457 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102850    5457 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102853    5457 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102856    5457 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 20:15:33.121367 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102858    5457 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:15:33.102861    5457 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.102912    5457 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.103903    5457 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.103959    5457 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.104126    5457 server.go:1014] "Starting client certificate rotation"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.104265    5457 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.104306    5457 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 20:09:21 +0000 UTC" deadline="2028-06-18 19:31:26.61959374 +0000 UTC"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.104343    5457 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14255h15m53.515252617s"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.104529    5457 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.105553    5457 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.107207    5457 log.go:25] "Validated CRI v1 runtime API"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.109037    5457 log.go:25] "Validated CRI v1 image API"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.109836    5457 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 20:15:33.122370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.111766    5457 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ada075e7-129d-4f67-8d12-77c82c8f8cc1:/dev/nvme0n1p4 cbaf8f4f-fd31-4bb5-a91a-0dc0f732cf25:/dev/nvme0n1p3]
Nov 02 20:15:33.122978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.111786    5457 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2/userdata/shm major:0 minor:311 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b/userdata/shm major:0 minor:300 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a/userdata/shm major:0 minor:52 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433/userdata/shm major:0 minor:360 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c/userdata/shm major:0 minor:373 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6/userdata/shm major:0 minor:377 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d/userdata/shm major:0 minor:274 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/tmp major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~projected/kube-api-access-6zn8q:{mountpoint:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~projected/kube-api-access-6zn8q major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~projected/kube-api-access-tpv5q:{mountpoint:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~projected/kube-api-access-tpv5q major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~projected/kube-api-access-rxhpk:{mountpoint:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~projected/kube-api-access-rxhpk major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d/volumes/kubernetes.io~projected/kube-api-access-prfp5:{mountpoint:/var/lib/kubelet/pods/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d/volumes/kubernetes.io~projected/kube-api-access-prfp5 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~projected/kube-api-access-h9tdn:{mountpoint:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~projected/kube-api-access-h9tdn major:0 minor:279 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e5313f6-f18b-493a-812a-8a6fccccaf0e/volumes/kubernetes.io~projected/kube-api-access-qwgg8:{mountpoint:/var/lib/kubelet/pods/3e5313f6-f18b-493a-812a-8a6fccccaf0e/volumes/kubernetes.io~projected/kube-api-access-qwgg8 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1/volumes/kubernetes.io~projected/kube-api-access-t945m:{mountpoint:/var/lib/kubelet/pods/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1/volumes/kubernetes.io~projected/kube-api-access-t945m major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a3c02ba-eb10-4b76-a903-17c55cd5b011/volumes/kubernetes.io~projected/kube-api-access-9vfx2:{mountpoint:/var/lib/kubelet/pods/4a3c02ba-eb10-4b76-a903-17c55cd5b011/volumes/kubernetes.io~projected/kube-api-access-9vfx2 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~projected/kube-api-access-57xjf:{mountpoint:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~projected/kube-api-access-57xjf major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66dfdd5f-6703-4846-bcb0-83f49098bc5f/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/66dfdd5f-6703-4846-bcb0-83f49098bc5f/volumes/kubernetes.io~secret/agent-certs major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~projected/kube-api-access-g92xh:{mountpoint:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~projected/kube-api-access-g92xh major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86b9a022-00f8-447c-881d-a9b045ae1196/volumes/kubernetes.io~projected/kube-api-access-dnjx2:{mountpoint:/var/lib/kubelet/pods/86b9a022-00f8-447c-881d-a9b045ae1196/volumes/kubernetes.io~projected/kube-api-access-dnjx2 major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~projected/kube-api-access-xwtjx:{mountpoint:/var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~projected/kube-api-access-xwtjx major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~secret/metrics-certs major:0 minor:366 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be869f32-baad-41a8-bc8e-85f43ad15327/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/be869f32-baad-41a8-bc8e-85f43ad15327/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb/volumes/kubernetes.io~projected/kube-api-access-wgzd6:{mountpoint:/var/lib/kubelet/pods/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb/volumes/kubernetes.io~projected/kube-api-access-wgzd6 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cfc49763-535f-43b4-979f-ff8d1e726222/volumes/kubernetes.io~projected/kube-api-access-2wk78:{mountpoint:/var/lib/kubelet/pods/cfc49763-535f-43b4-979f-ff8d1e726222/volumes/kubernetes.io~projected/kube-api-access-2wk78 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/alertmanager/9 major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/config-reloader/6 major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~empty-dir/config-out major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/kube-api-access-x4mkl:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/kube-api-access-x4mkl major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/tls-assets major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/config-volume major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/web-config major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~projected/kube-api-access-m5pn6:{mountpoint:/var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~projected/kube-api-access-m5pn6 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~secret/cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~projected/kube-api-access-wxgmb:{mountpoint:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~projected/kube-api-access-wxgmb major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~projected/kube-api-access-c8ssv:{mountpoint:/var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~projected/kube-api-access-c8ssv major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~projected/kube-api-access-rrdlv:{mountpoint:/var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~projected/kube-api-access-rrdlv major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/69cce0a8c3853ebc6ad2753b73ae9008b17b4b23e8832c6306398f4ad5e5a870/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/6c7c2a768da56dbb2a4667bc2d57b8226d53a76a922aa00e0c55aec164b34a04/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/eec92c1cc8557dc1b9a2ca4b4887c0b3559c1f6f7d84788c6dce1c84575a4b1f/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/6925f9521748a2491240ef0327d7505303d8b8baff2024176e1b347b40c5c51a/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/249f78331c18f56d98d2fbc8315bc014969ef973708c25ae91de15e30684aee1/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/e8a0dc92ed7bd561defe0618473f772a0be7e65c79437f8bea2f4486e5a3d82d/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/542493f91e99c96995e25168fdce88594aa6dda8a300a80a39aad1d265fd5516/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/c658b43916790a4651df85670685c6bad9af91e5191bb15638e21c1c85288e05/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/31a521e504eb6ace75e7443908897d6229e30b765d6916f5a3d8d438c2a941f5/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/c3898592e3d1745ac206156aaa83a06de38f6ae6ed7ba9fcadba93c06e020819/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-135:{mountpoint:/var/lib/containers/storage/overlay/97aabff56a5537cfd19dca60b942b0399ed11db344009649c04b666f43c322db/merged major:0 minor:135 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/5a5aa2f802bc0fd873824367975b188f0266cf7d1967e72843a8e2010b4d0f11/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/c39dac15adf50c5958f0c96891efacd172bca6a5841c3bd68d5ec84095a58380/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/92fd1ccf17bd2a9d6ab4c285241336a2eed6e26acbe5979b6f55e0b388b3c402/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/3cd289ca2d2f1dc8f90dca26fb1eada8cd86727b5f4bf2f4dd73a00e244d8773/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/69ee6059c8e81e1d40ab098e89f61343cbbff58ef8363f73c3e16256998c2050/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/37996f9d53ccb9fbfaa8bd02c447f2f80138a93e18afb6910aae1c6f300b75af/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/4bcb6d3fca2fba64da8f3af2f38c3cb6130b416bb3dc41c3c39f42cd1ffed1e8/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/ae3115b9bfcf590d516fa8ff24624779f16254df280f931255d7ad8f18170471/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e4ad54cae7521ec16ee38f22233ffecb01286a88e9c8784956eec9e138807651/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/50e5322b61b522ab7704184e54cee0cb38380b07d2981beecdc5b5e82f5f7075/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/2ab850aa76a56a79d18c344dfbe55800a45c94e3ae0cec9ca787a73a3f57babc/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/4b0170a07c5ec3a0c7486c6e9e840830486a579a626c7fb4dd73e4cdee920028/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/421ac691cef45f704a217bf0ea363228c1a90975c8fc923286d10fed30ac7477/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/0aa8326600b53453498d2238e1fd1dead7fd031ed340fc988a7a6c713eefce9f/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/34f94561353d7dc40bd18722dabdf9a4713dad7d98886c367a4728db8b7d637e/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/c4d800d137d2e92b537257b2b3b7d58de38974105fa070691fbe838165c05bb6/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/e799ef149ca65fc9f5da1310ebf9930d5f6d1cd9c4090555b23bf23521ca3e85/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/b7b92cf5ad09e4fd5f7f5cb829c73240abfb6f096814f70cb1b6e43e4d851520/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/ef3014846ce00f3c7c4689f01470a20a773550982a4af034d7cfb536ab5868ef/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/3ac7bd917e76cd071378f0bb7532bae998910b32a3848f62067591153aadd30f/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/7f4880a316e409cc58abe18886e2192c2ad3317f151817677b88b3d9cb9f6841/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/bf490a9ae9b7748e4953d1209edc47cf2cb8c7d2c4fa140b12d9ceb1bd437531/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/99403985ca82b3c0c0e9657c3035fdd9cc6f0800c2f93728e6873cfad9069e68/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/3f8d30987a739b85a82007a306773c9fe7b7100dfe888fa70d413272be9166f5/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/d3a31e197fb6f77148ed55b42fddc55cd9bd88117b434cd4b6e3f77705f3778d/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/18d69bf13f508927901ce208819a3ad738290c0402d4de23ba4b100c48e839eb/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/79327089cf052c7c1f314418be3a51d750a75daff07eb8a598b03fb359dc81da/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/ee0c79fac98f821f5d447cef42d60f53f8feb394ef5f57a5a88303a1fe414c1e/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/91a27f2b85fce0638edda5574af89e16219f03c2eca45e76199f3957bc94188e/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/cb424f80a84a297b5fb1d76bab5548661e120731516fb453317d0ee54161b93d/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/078b8d971d2eda528608f02972db65352bee49e043d3c617c9ae82af8a6a6b88/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/19422c58d9731575f9d32adbb92af14153c7d6bf220b123247a6953aae22b2b9/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/aa14017d02b1d5bc9a89e7dee8a34f6dfb2bfe7484cc9038a05ffaaac1b147e2/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/ee60681fe330a45d6136dcaf223feb83fdb1b2b646b6c9ecfffac5581d49f606/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/07e874057ca2249af510b63b27e5b15007a161885ca0137c73675c05f3a2c5c8/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/87194ebfb2d70a66daac58e9694e4e5b2cf8f4a5c93b83826836bc848aa13b8b/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/80e14fd2bf3b9abd1ac663a5890b921ea5fd5c5df8f87689ddd9824eb213d0ed/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/7fa8d717eea4db8766b3cf64553426e47a66628e4305debb34642a269021e311/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/30c26c2d712b2aa5a741c9f7e7b61c6c853f612880e1e04c1c4d7eab566d7687/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/b719a95f03a50e7201284dc6dda63ee24efbbca9a8e53b0af59d46ebf2092ab0/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/645fe6e1455c9be005f7ba0bd282e04f18c8fade12bd089298fc0cca2401a0f4/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/4e6ec431f7eb464cfc66fdc63283ff39a8f3b24f6b1249de577b334596d4f92a/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/366092a3904bb85246fb0fd1b3c11a9c0e9d90ed6469ac326ed41a0ae0e02dce/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/2ee8444a940cd16d5713a677b710451c1dfa70d18de3aafa1c6245a7c75d0a02/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/d22888e7e5f382d3a3705269df0ec0c4c581565d38e44916c9892766ec7acc71/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/3ff6bb4aa74fd45595121704dc825be99754edcc56c3b39ae8b3c35052662d30/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/a6182202de36d93a4bd7105f93f0afbdc18f2ad78cd400237abd8e7fd01c4f73/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/6fff99445e6fdfcb6e1cf82129728726f0c25120477070b6c95c2af660f4ddc5/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/e065aec1c2b7c6259e0e57ef712cb25b5a3973cad6543855865c4f9798aae95f/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/dc60e369e61a9f6ec8e1399032c9ab7a4c25dfe61bdd989f85eac7d6dedcefc2/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/4c26e8175fb13b8335b1fb304e203b756bfa18941afb8e2ee748043dc15f72a7/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/9ab08c83aceaf600ac32535cd0177e4dc5ff5242b455b76cf5df1be8faa25361/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/aa55c48d9236e3de171c01bceb601a08d42fe0b3413c810255e0a224b2c1dd35/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/56d14707a7f96c2d599008a85f76129dad9dd8a873d41af13021ee99cb1ac241/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/54afd988dc766bffbff9f37135f0e8524293d89be35573381471120334e75377/merged major:0 minor:98 fsType:overlay blockSize:0}]
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.120710    5457 manager.go:217] Machine: {Timestamp:2026-11-02 20:15:33.119316909 +0000 UTC m=+0.057705972 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199419 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec226d6829c2b670b202241ee416609e SystemUUID:ec226d68-29c2-b670-b202-241ee416609e BootID:e903b0ab-273d-4550-b323-e37431480b46 Filesystems:[{Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~projected/kube-api-access-h9tdn DeviceMajor:0 DeviceMinor:279 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:283 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:286 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1/volumes/kubernetes.io~projected/kube-api-access-t945m DeviceMajor:0 DeviceMinor:372 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86b9a022-00f8-447c-881d-a9b045ae1196/volumes/kubernetes.io~projected/kube-api-access-dnjx2 DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/be869f32-baad-41a8-bc8e-85f43ad15327/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:371 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49eac6610ac6a9d3407f684a268815cb36bbe6b80517d6cf11976437506c0872/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1c95b73acdf85d554ee7a2a23bafbd833c67ac1561021dcfef43224ff313476e/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b/userdata/shm DeviceMajor:0 DeviceMinor:300 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb/volumes/kubernetes.io~projected/kube-api-access-wgzd6 DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:289 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~projected/kube-api-access-wxgmb DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:242 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:291 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9ce13ba6fca501ee148ab9660f0c274bc1035ba740708bc298f5ed3fa7a21c6/userdata/shm DeviceMajor:0 DeviceMinor:377 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b2a830fc73802b87c6ee761dc57c6d284aed27832a5f01536390bdec48350846/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:273 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dda7558f97d27f2b73f6667cd332713d0dfbb42c58e78e0a26faa9b21442be1d/userdata/shm DeviceMajor:0 DeviceMinor:274 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e5313f6-f18b-493a-812a-8a6fccccaf0e/volumes/kubernetes.io~projected/kube-api-access-qwgg8 DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b646ce78972aa6fe609ef648e8c14d97dcc7b0899d24e4a5d6089ba81ab624d0/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:285 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:241 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d/volumes/kubernetes.io~projected/kube-api-access-prfp5 DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:285 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~projected/kube-api-access-6zn8q DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:308 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e2647ed93ce7939f7faabe139594e70b0aaa7b9f1fa7db7008646efcd54acf4f/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3ce01914-1334-4916-95b5-557392e76335/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:272 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~projected/kube-api-access-x4mkl DeviceMajor:0 DeviceMinor:294 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:354 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a0596b7f9cf29a8ceaf1e6f39350dff6c2136a3ec0655b216564a9a16a9b975c/userdata/shm DeviceMajor:0 DeviceMinor:373 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~projected/kube-api-access-xwtjx DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~projected/kube-api-access-rxhpk DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/23577fb2-f316-4afa-bc93-fb8cd1ff75a4/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes/kubernetes.io~projected/kube-api-access-tpv5q DeviceMajor:0 DeviceMinor:243 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/66dfdd5f-6703-4846-bcb0-83f49098bc5f/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:307 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~projected/kube-api-access-57xjf DeviceMajor:0 DeviceMinor:310 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:358 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes/kubernetes.io~projected/kube-api-access-g92xh DeviceMajor:0 DeviceMinor:359 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433/userdata/shm DeviceMajor:0 DeviceMinor:360 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dca97178-94dc-4858-9824-06c0c0e91c03/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~projected/kube-api-access-m5pn6 DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-135 DeviceMajor:0 DeviceMinor:135 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~projected/kube-api-access-rrdlv DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49f4c683432cd1c36858f491bb3b199149605b78fa8de655d44a2056d3057ce1/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3a30bcee-6023-42e4-b8e5-334a8005aa92/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0104a4918c23f66b19da972d4cfae98e9cb27d9539405fbc92bd41b315cf1ea2/userdata/shm DeviceMajor:0 DeviceMinor:311 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b66460cdfbadb0ec042be85193bbee8b8d665c3923aa8a878054c52ea4267e7/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f90367f9-3755-4c66-80bc-e702b2e7b262/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cfc49763-535f-43b4-979f-ff8d1e726222/volumes/kubernetes.io~projected/kube-api-access-2wk78 DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/628a5564e29d196d14ee04d637931d1afbff540746004f6f86107b626b93c73a/userdata/shm DeviceMajor:0 DeviceMinor:52 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f87949fefa828410b8473eb7c1c44a70e7c488ec42670e5fb6f25acfa262bdc2/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a912dbc-638d-499d-b597-b89194a13603/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:309 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:285 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a3c02ba-eb10-4b76-a903-17c55cd5b011/volumes/kubernetes.io~projected/kube-api-access-9vfx2 DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e42210710fd720b5109b4a0fc23f6cbc82d2c805fcd924b007552b958f4de5c4/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:284 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bcc562af-9600-4878-99a4-ab8145971dc3/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:366 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:290 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f66aa142-2dd9-46ab-a304-5d96b9d01b38/volumes/kubernetes.io~projected/kube-api-access-c8ssv DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88054c12d35afe6e3d68fdd1cc536a4990565d7882a4d9089eabba2f48e04656/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d39d9732-2759-45d2-b5ab-4d78379170ab/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/208c000ed79f45fe92239b9b5decbfadffab30c545b5eb5e765e53beced78fe3/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/01fd9070d90f85b280debeaac72fd503ee5f537a82550931f802e917bc8c8d09/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:285 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0104a4918c23f66 MacAddress:7a:6e:57:bc:54:81 Speed:10000 Mtu:8901} {Name:0d231630aa960a2 MacAddress:5a:66:63:b0:b4:07 Speed:10000 Mtu:8901} {Name:49eac6610ac6a9d MacAddress:66:6a:13:46:6b:79 Speed:10000 Mtu:8901} {Name:49f4c683432cd1c MacAddress:aa:00:e0:70:90:e7 Speed:10000 Mtu:8901} {Name:5cea94520fa2574 MacAddress:06:b3:b4:60:f4:b8 Speed:10000 Mtu:8901} {Name:8588218db82911b MacAddress:06:39:c8:23:72:9e Speed:10000 Mtu:8901} {Name:88054c12d35afe6 MacAddress:9e:61:b8:c6:c4:fc Speed:10000 Mtu:8901} {Name:a0596b7f9cf29a8 MacAddress:ba:f7:83:39:bd:f2 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:f4:d1:aa:55 Speed:0 Mtu:9001} {Name:br-int MacAddress:ee:57:3b:51:ce:ab Speed:0 Mtu:8901} {Name:d9ce13ba6fca501 MacAddress:da:d8:71:5b:9e:ef Speed:10000 Mtu:8901} {Name:e2647ed93ce7939 MacAddress:36:76:86:e2:67:41 Speed:10000 Mtu:8901} {Name:e42210710fd720b MacAddress:1e:e8:a1:09:9f:31 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:f4:d1:aa:55 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:82:49:07:48:3a:a3 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b6:e5:e1:13:e2:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121057    5457 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121105    5457 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121457    5457 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121487    5457 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-201.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121706    5457 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121719    5457 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121734    5457 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121753    5457 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.121869    5457 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122085    5457 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122222    5457 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122268    5457 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122288    5457 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122302    5457 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122315    5457 kubelet.go:405] "Adding apiserver pod source"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.122327    5457 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.123203    5457 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 20:15:33.123404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.123216    5457 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 20:15:33.124213 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.123693    5457 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 20:15:33.126177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126162    5457 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 20:15:33.126177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126177    5457 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 20:15:33.126278 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126268    5457 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 02 20:15:33.126468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126457    5457 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 20:15:33.126504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126486    5457 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 20:15:33.126582 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126573    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 20:15:33.126612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126590    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 20:15:33.126612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126611    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126618    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126624    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126630    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126635    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126641    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126660    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 20:15:33.126674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126666    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 20:15:33.126906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126678    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 20:15:33.126906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126701    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 20:15:33.126906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126726    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 20:15:33.126906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.126733    5457 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 20:15:33.129980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.129964    5457 server.go:1263] "Started kubelet"
Nov 02 20:15:33.130084 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.130049    5457 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 20:15:33.130144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.130070    5457 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 20:15:33.130195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.130165    5457 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 20:15:33.130525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.130503    5457 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 20:15:33.130516 ip-10-0-134-201 systemd[1]: Started Kubernetes Kubelet.
Nov 02 20:15:33.133476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.132606    5457 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 20:15:33.136497 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.133798    5457 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 20:15:33.136497 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.133849    5457 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 20:15:33.136497 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.134061    5457 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 20:09:22 +0000 UTC" deadline="2028-06-29 01:17:59.979340934 +0000 UTC"
Nov 02 20:15:33.136497 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.134098    5457 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14501h2m26.845246849s"
Nov 02 20:15:33.137578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.137541    5457 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 20:15:33.137578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.137561    5457 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.137850    5457 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-201.us-west-2.compute.internal\" not found"
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.138291    5457 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140205    5457 factory.go:55] Registering systemd factory
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140227    5457 factory.go:223] Registration of the systemd container factory successfully
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140497    5457 factory.go:153] Registering CRI-O factory
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140514    5457 factory.go:223] Registration of the crio container factory successfully
Nov 02 20:15:33.140622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140595    5457 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 20:15:33.141019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140786    5457 factory.go:103] Registering Raw factory
Nov 02 20:15:33.141019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.140808    5457 manager.go:1199] Started watching for new ooms in manager
Nov 02 20:15:33.141481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.141461    5457 manager.go:319] Starting recovery of all containers
Nov 02 20:15:33.143141 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143095    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca97178-94dc-4858-9824-06c0c0e91c03" volumeName="kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb" seLinuxMountContext=""
Nov 02 20:15:33.143221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143145    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert" seLinuxMountContext=""
Nov 02 20:15:33.143221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143162    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" volumeName="kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 02 20:15:33.143221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143176    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle" seLinuxMountContext=""
Nov 02 20:15:33.143221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143190    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config" seLinuxMountContext=""
Nov 02 20:15:33.143221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143203    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcc562af-9600-4878-99a4-ab8145971dc3" volumeName="kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143214    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca97178-94dc-4858-9824-06c0c0e91c03" volumeName="kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143240    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143260    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143275    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143288    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143325    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143339    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143351    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a30bcee-6023-42e4-b8e5-334a8005aa92" volumeName="kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls" seLinuxMountContext=""
Nov 02 20:15:33.143370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143368    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f66aa142-2dd9-46ab-a304-5d96b9d01b38" volumeName="kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143380    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f90367f9-3755-4c66-80bc-e702b2e7b262" volumeName="kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143392    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f90367f9-3755-4c66-80bc-e702b2e7b262" volumeName="kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143404    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a30bcee-6023-42e4-b8e5-334a8005aa92" volumeName="kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143416    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143429    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66dfdd5f-6703-4846-bcb0-83f49098bc5f" volumeName="kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143443    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66dfdd5f-6703-4846-bcb0-83f49098bc5f" volumeName="kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143454    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143467    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcc562af-9600-4878-99a4-ab8145971dc3" volumeName="kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143479    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143491    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143505    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23577fb2-f316-4afa-bc93-fb8cd1ff75a4" volumeName="kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143519    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143533    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a3c02ba-eb10-4b76-a903-17c55cd5b011" volumeName="kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143550    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1c50dd7-2082-4b1f-bfe0-0d4568f329bb" volumeName="kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143563    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfc49763-535f-43b4-979f-ff8d1e726222" volumeName="kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143575    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143589    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f66aa142-2dd9-46ab-a304-5d96b9d01b38" volumeName="kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 02 20:15:33.143613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143603    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143615    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143641    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143654    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143666    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f66aa142-2dd9-46ab-a304-5d96b9d01b38" volumeName="kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143678    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a30bcee-6023-42e4-b8e5-334a8005aa92" volumeName="kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143707    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" volumeName="kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143721    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" volumeName="kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143735    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e5313f6-f18b-493a-812a-8a6fccccaf0e" volumeName="kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143746    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143759    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143770    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e5313f6-f18b-493a-812a-8a6fccccaf0e" volumeName="kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143779    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" volumeName="kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143786    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143793    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143801    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143808    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86b9a022-00f8-447c-881d-a9b045ae1196" volumeName="kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143816    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143825    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143833    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143840    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143859    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfc49763-535f-43b4-979f-ff8d1e726222" volumeName="kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143867    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143874    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143888    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d39d9732-2759-45d2-b5ab-4d78379170ab" volumeName="kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143896    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca97178-94dc-4858-9824-06c0c0e91c03" volumeName="kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143903    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23577fb2-f316-4afa-bc93-fb8cd1ff75a4" volumeName="kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143910    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143918    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143927    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143934    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143941    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f90367f9-3755-4c66-80bc-e702b2e7b262" volumeName="kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143948    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f90367f9-3755-4c66-80bc-e702b2e7b262" volumeName="kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143955    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be869f32-baad-41a8-bc8e-85f43ad15327" volumeName="kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143963    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca97178-94dc-4858-9824-06c0c0e91c03" volumeName="kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143989    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f66aa142-2dd9-46ab-a304-5d96b9d01b38" volumeName="kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.143997    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23577fb2-f316-4afa-bc93-fb8cd1ff75a4" volumeName="kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144005    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144013    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" volumeName="kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144032    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1" volumeName="kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144039    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144047    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144055    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86b9a022-00f8-447c-881d-a9b045ae1196" volumeName="kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144062    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d06defd7-ffcb-4a3b-8567-82c85286ec73" volumeName="kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144070    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca97178-94dc-4858-9824-06c0c0e91c03" volumeName="kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144079    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfc49763-535f-43b4-979f-ff8d1e726222" volumeName="kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144086    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a30bcee-6023-42e4-b8e5-334a8005aa92" volumeName="kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144093    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ce01914-1334-4916-95b5-557392e76335" volumeName="kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144101    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a3c02ba-eb10-4b76-a903-17c55cd5b011" volumeName="kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144116    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a912dbc-638d-499d-b597-b89194a13603" volumeName="kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144123    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7329985d-9aae-4933-972a-6f854d133528" volumeName="kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144131    5457 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d39d9732-2759-45d2-b5ab-4d78379170ab" volumeName="kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6" seLinuxMountContext=""
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144137    5457 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 20:15:33.144391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.144142    5457 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 20:15:33.164321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.164285    5457 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 20:15:33.166032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.165710    5457 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 20:15:33.166032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.165738    5457 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 20:15:33.166032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.165760    5457 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 20:15:33.166032 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.165793    5457 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 02 20:15:33.175987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.175962    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:15:33.177312 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.177290    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:15:33.178952 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.178916    5457 generic.go:356] "Generic (PLEG): container finished" podID="3ce01914-1334-4916-95b5-557392e76335" containerID="7566f5faf553bbba62616fcb4fafd2a340fb6727d414dd955d76f0f14c831d12" exitCode=0
Nov 02 20:15:33.189978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.189951    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61" exitCode=0
Nov 02 20:15:33.194648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194609    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="cab409ffe47dc79853669af88b9e7cab121267d41fc3d77b8287aa7e8a2322f6" exitCode=0
Nov 02 20:15:33.194648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194645    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="a145288bba209dd25c7994cf3d69191cdc81cc3a78eb0e53d0a6836c8053fe86" exitCode=0
Nov 02 20:15:33.194648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194652    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="c2ed6c61fdbcf757a5b22a8cc48dea928a002b8d91fb630895067461210d54db" exitCode=0
Nov 02 20:15:33.194853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194658    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="4c0b334f69ba7cc00260985e6e7c0e6ad368fde342639c3ea2761723712acbfb" exitCode=0
Nov 02 20:15:33.194853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194664    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="932b71526f77bca8d2a8fc0e639a2fa5f2525991a951e8d52be52211ead5b776" exitCode=0
Nov 02 20:15:33.194853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.194669    5457 generic.go:356] "Generic (PLEG): container finished" podID="3b8dbfb9-508d-4a99-9508-8d9a3b5b749d" containerID="9e083ebfb656f7d6360316c62f74d87adfb3048bd8248f1cf13097456cc66737" exitCode=0
Nov 02 20:15:33.198436 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.198417    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:15:33.198827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.198800    5457 generic.go:356] "Generic (PLEG): container finished" podID="dca97178-94dc-4858-9824-06c0c0e91c03" containerID="b41c488bf781c285b4be5b2785087b4fa3528568a561dc3874b41a0b8f6b638e" exitCode=1
Nov 02 20:15:33.221789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.221756    5457 generic.go:356] "Generic (PLEG): container finished" podID="a5437ce875acadcf23a36788079a5aa7" containerID="c435d83b387df0ee27e63d32fdb3b183d7fdd2f02f769463c1df3d843000db4d" exitCode=0
Nov 02 20:15:33.237927 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.237904    5457 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-201.us-west-2.compute.internal\" not found"
Nov 02 20:15:33.239769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.239750    5457 manager.go:324] Recovery completed
Nov 02 20:15:33.258102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.258073    5457 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:15:33.260476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.260451    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:15:33.260576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.260489    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:15:33.260576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.260502    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:15:33.262869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.262851    5457 cpu_manager.go:226] "Starting" policy="none"
Nov 02 20:15:33.262869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.262864    5457 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 20:15:33.262975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.262870    5457 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:15:33.262975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.262880    5457 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 20:15:33.263027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.262992    5457 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 02 20:15:33.263027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263002    5457 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 02 20:15:33.263160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263150    5457 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 02 20:15:33.263190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263160    5457 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 02 20:15:33.263190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263166    5457 policy_none.go:50] "Start"
Nov 02 20:15:33.263190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263174    5457 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 20:15:33.263190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263183    5457 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 20:15:33.263316 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263306    5457 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 02 20:15:33.263348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263316    5457 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 02 20:15:33.263348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263322    5457 policy_none.go:44] "Start"
Nov 02 20:15:33.263741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263722    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:15:33.263798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263760    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:15:33.263798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.263774    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:15:33.265887 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.265831    5457 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 02 20:15:33.267722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.267668    5457 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 20:15:33.271580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.271566    5457 manager.go:341] "Starting Device Plugin manager"
Nov 02 20:15:33.271654 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.271594    5457 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 20:15:33.271654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.271603    5457 server.go:87] "Starting device plugin registration server"
Nov 02 20:15:33.271935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.271922    5457 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 20:15:33.271970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.271942    5457 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 20:15:33.272055 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.272038    5457 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 20:15:33.272175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.272141    5457 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 20:15:33.272289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.272179    5457 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 20:15:33.272289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.272186    5457 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 20:15:33.272391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.272253    5457 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T20:15:33.272169775Z","UUID":"093ff95f-567c-449f-9731-64bc900e3962","Handler":null,"Name":"","Endpoint":""}
Nov 02 20:15:33.273567 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.273550    5457 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 20:15:33.273642 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.273577    5457 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 20:15:33.273792 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.273765    5457 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 20:15:33.273885 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.273813    5457 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-201.us-west-2.compute.internal\" not found"
Nov 02 20:15:33.320700 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.320663    5457 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:15:33.320700 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.320680    5457 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:15:33.320872 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.320801    5457 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 02 20:15:33.321476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.321457    5457 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:15:33.373019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.372992    5457 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 20:15:33.374095 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.374066    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 20:15:33.374226 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.374104    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 20:15:33.374226 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.374119    5457 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-201.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 20:15:33.374226 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.374175    5457 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.412513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.412479    5457 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 20:15:33.466735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.466658    5457 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"]
Nov 02 20:15:33.467397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.467349    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"b526d8000ee2153ea8f69907c814c3ac","Type":"ContainerStarted","Data":"ad4be1cf3e0073c422e2e88ada179bdac902b2a0ae3d5e74957376ba94763631"}
Nov 02 20:15:33.467788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.467739    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"b526d8000ee2153ea8f69907c814c3ac","Type":"ContainerStarted","Data":"e78b8820b00a5101b510c293c4c49c6af840c17ac89f4dde1765f0940e21ec4f"}
Nov 02 20:15:33.467917 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.467813    5457 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.467983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.467959    5457 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.469940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.469415    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerStarted","Data":"5820524a573119c6f9581ff059a9f83c243e7974ffdfd87bbe34f241057f4304"}
Nov 02 20:15:33.469940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.469528    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerDied","Data":"c435d83b387df0ee27e63d32fdb3b183d7fdd2f02f769463c1df3d843000db4d"}
Nov 02 20:15:33.469940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.469562    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal" event={"ID":"a5437ce875acadcf23a36788079a5aa7","Type":"ContainerStarted","Data":"5c58cf8374b0dfb5e03603bf264cfe1a2ab4fedfcd985293d6bedd6a21131972"}
Nov 02 20:15:33.481167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.481148    5457 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.481271 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.481213    5457 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.524889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.524823    5457 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:15:33.524889 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.524868    5457 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.525400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.525378    5457 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:15:33.525508 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:33.525425    5457 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.621641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.621607    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.621641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.621639    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.621847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.621657    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722809 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722774    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722835    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722853    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722878    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b526d8000ee2153ea8f69907c814c3ac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"b526d8000ee2153ea8f69907c814c3ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722883    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:33.722970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:33.722888    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5437ce875acadcf23a36788079a5aa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" (UID: \"a5437ce875acadcf23a36788079a5aa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:34.122568 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.122490    5457 apiserver.go:52] "Watching apiserver"
Nov 02 20:15:34.227449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.227420    5457 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:34.227616 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.227597    5457 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:34.265314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.265288    5457 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 20:15:34.265870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.265850    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx","openshift-network-diagnostics/network-check-target-dng75","openshift-network-operator/iptables-alerter-kdwv2","openshift-console/console-665d9fc779-6kjqm","openshift-image-registry/node-ca-m2nwz","kube-system/global-pull-secret-syncer-wzb8x","kube-system/konnectivity-agent-mtm8t","openshift-dns/node-resolver-9cldl","openshift-multus/multus-additional-cni-plugins-dpm95","openshift-monitoring/node-exporter-g7q92","openshift-ovn-kubernetes/ovnkube-node-6dfn5","openshift-ingress-canary/ingress-canary-9ktqv","openshift-multus/network-metrics-daemon-9lcqr","openshift-monitoring/alertmanager-main-0","openshift-console/console-5f757d487-2j98h","openshift-monitoring/metrics-server-7fcf46cb44-6pxtz","openshift-multus/multus-k5cwd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-bx89s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt","openshift-insights/insights-runtime-extractor-94wh7","kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal","openshift-dns/dns-default-4x878"]
Nov 02 20:15:34.282518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.282496    5457 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:15:34.282636 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:34.282542    5457 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:34.283072 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.283054    5457 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 20:15:34.283177 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:34.283088    5457 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-201.us-west-2.compute.internal"
Nov 02 20:15:34.321718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321671    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 20:15:34.321824 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321810    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.321890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321824    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.321890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321857    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.321995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321866    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.321995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321912    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.321995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.321966    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322009    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322018    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322017    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322022    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322055    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322067    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 20:15:34.322140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322069    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322153    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322159    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322173    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322177    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322193    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322208    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322218    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322228    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322234    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322212    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322278    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322412    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 20:15:34.322467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322424    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 20:15:34.322936 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.322922    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 20:15:34.323664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323628    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 20:15:34.323782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323707    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 20:15:34.323782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323729    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d6nbh\""
Nov 02 20:15:34.323782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323735    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 20:15:34.323782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323745    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-t6dvk\""
Nov 02 20:15:34.323782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323775    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-4wc8w\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323791    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-7bq62\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323866    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323867    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323900    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjrtf\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323935    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7m5tr\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323948    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kz985\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323965    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hxslf\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323981    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-74k7h\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323993    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 20:15:34.324015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.323986    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29pz\""
Nov 02 20:15:34.324343 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.324033    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-ldshw\""
Nov 02 20:15:34.324343 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.324070    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qfmz2\""
Nov 02 20:15:34.324343 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.324110    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5vs7j\""
Nov 02 20:15:34.324742 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.324730    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.324810 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.324799    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 20:15:34.328787 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.328771    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 20:15:34.329315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.329299    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.329404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.329377    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 20:15:34.340069 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.340054    5457 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 20:15:34.365876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.365851    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 02 20:15:34.365958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.365895    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82tkg\""
Nov 02 20:15:34.365958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.365922    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 20:15:34.366241 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.366225    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.366279 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.366262    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 02 20:15:34.366346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.366331    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xxqx9\""
Nov 02 20:15:34.366403 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.366393    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c5lbk\""
Nov 02 20:15:34.366461 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.366452    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 20:15:34.422971 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.422949    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 02 20:15:34.423112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.422987    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.423112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423005    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 20:15:34.423112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423026    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423116    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423125    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423127    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423191    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423201    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423233    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 02 20:15:34.423242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423242    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423268    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423287    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423334    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423351    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423335    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423381    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bvgts\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423399    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423477    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423492    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 20:15:34.423502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423495    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423513    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423580    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423602    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qlcqs\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423618    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nm4xn\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423631    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423805    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cmv8mitksohj6\""
Nov 02 20:15:34.423837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.423833    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7zgsp\""
Nov 02 20:15:34.425448 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.425411    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 02 20:15:34.425518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.425454    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 02 20:15:34.428038 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428020    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pn6\" (UniqueName: \"kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:34.428113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428054    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428080    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.428113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428108    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.428245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428136    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.428245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428163    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.428245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428189    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428324    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428336    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428382    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.428484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428394    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-client-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.428484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428419    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.428484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428464    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.428484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428474    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428504    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.428654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428522    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.428654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428623    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.428770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428652    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.428770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428673    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.428770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428674    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be869f32-baad-41a8-bc8e-85f43ad15327-original-pull-secret\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.428770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428745    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgg8\" (UniqueName: \"kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.428770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428767    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.428988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428784    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgmb\" (UniqueName: \"kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.428988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428808    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.428988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428871    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce01914-1334-4916-95b5-557392e76335-node-exporter-textfile\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.428988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428920    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.428988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.428940    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.429223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429102    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.429223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429137    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.429320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429238    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3c02ba-eb10-4b76-a903-17c55cd5b011-serviceca\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.429464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429424    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.429519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429460    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.429939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429908    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.430090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429926    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.430090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.429971    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.430090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430069    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wk78\" (UniqueName: \"kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.430237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430095    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.430237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430126    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.430237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430156    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.430411 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430383    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f90367f9-3755-4c66-80bc-e702b2e7b262-metrics-tls\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.430520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430489    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.430619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430493    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.430619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430552    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.430619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430579    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430636    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430679    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430732    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430750    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430765    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430784    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430824    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430841    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430856    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430870    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.430882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430879    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430888    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430885    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430946    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430962    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430975    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.430973    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86b9a022-00f8-447c-881d-a9b045ae1196-iptables-alerter-script\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431017    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.431300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431075    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzd6\" (UniqueName: \"kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431346    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhpk\" (UniqueName: \"kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431395    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431464    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431466    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431531    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431532    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431596    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.431705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431610    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.432041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431790    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.432041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431861    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.432041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431903    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.432041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431936    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.432041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.431965    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.432285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432107    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a912dbc-638d-499d-b597-b89194a13603-audit-log\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.432285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432201    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.432285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432234    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:34.432285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432244    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.432490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432297    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57xjf\" (UniqueName: \"kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.432490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432304    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-multus-daemon-config\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.432592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432563    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.432643 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432598    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zn8q\" (UniqueName: \"kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.432643 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432601    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d39d9732-2759-45d2-b5ab-4d78379170ab-cert\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:34.432807 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432788    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.432857 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432832    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.432911 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432897    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.432966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432932    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.433012 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.432997    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.433057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433027    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.433102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433060    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.433146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433110    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce01914-1334-4916-95b5-557392e76335-node-exporter-tls\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.433191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433152    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjx2\" (UniqueName: \"kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.433191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433184    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.433319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433218    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.433319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433248    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.433404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433316    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.433404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433326    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.433404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433355    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.433404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433373    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f90367f9-3755-4c66-80bc-e702b2e7b262-tmp-dir\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.433404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433384    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.433623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433420    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.433623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433467    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.433623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433503    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.433623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433572    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433623    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433658    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ssv\" (UniqueName: \"kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433711    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433740    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prfp5\" (UniqueName: \"kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433771    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.433818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433802    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433836    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433845    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433868    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vfx2\" (UniqueName: \"kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433924    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.433961    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.434102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434054    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434455    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f90367f9-3755-4c66-80bc-e702b2e7b262-config-volume\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434480    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-metrics-client-ca\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434508    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434544    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434576    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.434628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434603    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434633    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434673    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434706    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-env-overrides\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434728    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434758    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434782    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434812    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434843    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434871    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.434948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.434900    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435040    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435076    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435109    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435140    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435149    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435172    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435204    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435231    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435265    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435299    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.435346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435332    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435356    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435399    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435430    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435460    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435484    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435518    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435545    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce01914-1334-4916-95b5-557392e76335-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.435829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435551    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.436175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435830    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a30bcee-6023-42e4-b8e5-334a8005aa92-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.436175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.435897    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.436175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436097    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.436346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436175    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-tls\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.436346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436296    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66aa142-2dd9-46ab-a304-5d96b9d01b38-data-volume\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.436438 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436359    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a30bcee-6023-42e4-b8e5-334a8005aa92-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.436438 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436403    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5313f6-f18b-493a-812a-8a6fccccaf0e-tmp-dir\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.436530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436453    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.436530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436513    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-tmp\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.436635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436579    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.436704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436643    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a912dbc-638d-499d-b597-b89194a13603-secret-metrics-server-client-certs\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.436704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436614    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a912dbc-638d-499d-b597-b89194a13603-metrics-server-audit-profiles\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.436817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436712    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.436817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436749    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfc49763-535f-43b4-979f-ff8d1e726222-cni-binary-copy\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.436817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436771    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.436817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436793    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.436817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436802    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436881    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436906    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436927    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436930    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-script-lib\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436978    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436978    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66dfdd5f-6703-4846-bcb0-83f49098bc5f-agent-certs\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.436992    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437022    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437029    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.437053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437047    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.437410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437076    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdlv\" (UniqueName: \"kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.437410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437080    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dca97178-94dc-4858-9824-06c0c0e91c03-ovn-node-metrics-cert\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.437410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437128    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.437410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437134    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc562af-9600-4878-99a4-ab8145971dc3-metrics-certs\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:34.437410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437192    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tdn\" (UniqueName: \"kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.437631 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437604    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.437740 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437721    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.437825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437749    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f66aa142-2dd9-46ab-a304-5d96b9d01b38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.437886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437819    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.437886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437861    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:34.437886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437863    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-tuned\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.438010 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437908    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.438010 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437940    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtjx\" (UniqueName: \"kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:34.438010 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.437981    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.438109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438064    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.438187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438171    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.438239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438224    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.438280 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438261    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.438332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438296    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.438380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438347    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.438418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438391    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:15:34.438459 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438452    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.438493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438480    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.438541 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438532    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.438617 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438598    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66dfdd5f-6703-4846-bcb0-83f49098bc5f-konnectivity-ca\") pod \"konnectivity-agent-mtm8t\" (UID: \"66dfdd5f-6703-4846-bcb0-83f49098bc5f\") " pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:15:34.438755 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.438739    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dca97178-94dc-4858-9824-06c0c0e91c03-ovnkube-config\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.483538 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.483515    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgg8\" (UniqueName: \"kubernetes.io/projected/3e5313f6-f18b-493a-812a-8a6fccccaf0e-kube-api-access-qwgg8\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.483665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.483518    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pn6\" (UniqueName: \"kubernetes.io/projected/d39d9732-2759-45d2-b5ab-4d78379170ab-kube-api-access-m5pn6\") pod \"ingress-canary-9ktqv\" (UID: \"d39d9732-2759-45d2-b5ab-4d78379170ab\") " pod="openshift-ingress-canary/ingress-canary-9ktqv"
Nov 02 20:15:34.483964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.483947    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"alertmanager-main-0\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:15:34.484805 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.484781    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wk78\" (UniqueName: \"kubernetes.io/projected/cfc49763-535f-43b4-979f-ff8d1e726222-kube-api-access-2wk78\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.489661 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.489641    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgmb\" (UniqueName: \"kubernetes.io/projected/dca97178-94dc-4858-9824-06c0c0e91c03-kube-api-access-wxgmb\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.496205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496182    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"console-5f757d487-2j98h\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") " pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:34.496641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496621    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjx2\" (UniqueName: \"kubernetes.io/projected/86b9a022-00f8-447c-881d-a9b045ae1196-kube-api-access-dnjx2\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.496766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496746    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ssv\" (UniqueName: \"kubernetes.io/projected/f66aa142-2dd9-46ab-a304-5d96b9d01b38-kube-api-access-c8ssv\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.496923 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496903    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57xjf\" (UniqueName: \"kubernetes.io/projected/5a912dbc-638d-499d-b597-b89194a13603-kube-api-access-57xjf\") pod \"metrics-server-7fcf46cb44-6pxtz\" (UID: \"5a912dbc-638d-499d-b597-b89194a13603\") " pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:15:34.497019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496918    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzd6\" (UniqueName: \"kubernetes.io/projected/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kube-api-access-wgzd6\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.497019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496903    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"console-665d9fc779-6kjqm\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") " pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:34.497019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.496976    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhpk\" (UniqueName: \"kubernetes.io/projected/3a30bcee-6023-42e4-b8e5-334a8005aa92-kube-api-access-rxhpk\") pod \"prometheus-operator-9cd89b74c-8pbzx\" (UID: \"3a30bcee-6023-42e4-b8e5-334a8005aa92\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8pbzx"
Nov 02 20:15:34.497223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497198    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prfp5\" (UniqueName: \"kubernetes.io/projected/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-kube-api-access-prfp5\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.497306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497282    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtjx\" (UniqueName: \"kubernetes.io/projected/bcc562af-9600-4878-99a4-ab8145971dc3-kube-api-access-xwtjx\") pod \"network-metrics-daemon-9lcqr\" (UID: \"bcc562af-9600-4878-99a4-ab8145971dc3\") " pod="openshift-multus/network-metrics-daemon-9lcqr"
Nov 02 20:15:34.497458 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497419    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vfx2\" (UniqueName: \"kubernetes.io/projected/4a3c02ba-eb10-4b76-a903-17c55cd5b011-kube-api-access-9vfx2\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.497533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497486    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zn8q\" (UniqueName: \"kubernetes.io/projected/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-kube-api-access-6zn8q\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.497533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497511    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tdn\" (UniqueName: \"kubernetes.io/projected/3ce01914-1334-4916-95b5-557392e76335-kube-api-access-h9tdn\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.497659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497578    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdlv\" (UniqueName: \"kubernetes.io/projected/f90367f9-3755-4c66-80bc-e702b2e7b262-kube-api-access-rrdlv\") pod \"dns-default-4x878\" (UID: \"f90367f9-3755-4c66-80bc-e702b2e7b262\") " pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:34.497913 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.497891    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t945m\" (UniqueName: \"kubernetes.io/projected/45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1-kube-api-access-t945m\") pod \"network-check-target-dng75\" (UID: \"45eb4e5c-c7f6-41c8-a710-af60ec0dc3e1\") " pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:34.539407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539387    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.539488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539415    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539432    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.539488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539448    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.539488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539463    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.539488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539477    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539506    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f66aa142-2dd9-46ab-a304-5d96b9d01b38-crio-socket\") pod \"insights-runtime-extractor-94wh7\" (UID: \"f66aa142-2dd9-46ab-a304-5d96b9d01b38\") " pod="openshift-insights/insights-runtime-extractor-94wh7"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539518    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539528    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-etc-kubernetes\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539505    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-netns\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539550    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-kubernetes\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539544    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539541    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539596    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-node-exporter-wtmp\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539601    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539627    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-k8s-cni-cncf-io\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539636    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539662    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539698    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539717    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-dbus\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539721    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539718    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-node-log\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539749    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539757    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.539759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539764    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539768    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539784    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-var-lib-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539786    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539797    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-netns\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539803    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539832    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539848    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539867    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539883    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-socket-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539895    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539895    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86b9a022-00f8-447c-881d-a9b045ae1196-host-slash\") pod \"iptables-alerter-kdwv2\" (UID: \"86b9a022-00f8-447c-881d-a9b045ae1196\") " pod="openshift-network-operator/iptables-alerter-kdwv2"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539917    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-system-cni-dir\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539950    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539979    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-conf\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.539979    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540023    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-modprobe-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540023    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540034    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b8dbfb9-508d-4a99-9508-8d9a3b5b749d-cnibin\") pod \"multus-additional-cni-plugins-dpm95\" (UID: \"3b8dbfb9-508d-4a99-9508-8d9a3b5b749d\") " pod="openshift-multus/multus-additional-cni-plugins-dpm95"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540077    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540106    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540125    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-lib-modules\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540130    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540142    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-slash\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540176    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-registration-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540273    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540338    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be869f32-baad-41a8-bc8e-85f43ad15327-kubelet-config\") pod \"global-pull-secret-syncer-wzb8x\" (UID: \"be869f32-baad-41a8-bc8e-85f43ad15327\") " pod="kube-system/global-pull-secret-syncer-wzb8x"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540361    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540372    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysctl-d\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540401    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-root\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540378    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540425    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-device-dir\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540438    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540466    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540501    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540516    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540523    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540541    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3c02ba-eb10-4b76-a903-17c55cd5b011-host\") pod \"node-ca-m2nwz\" (UID: \"4a3c02ba-eb10-4b76-a903-17c55cd5b011\") " pod="openshift-image-registry/node-ca-m2nwz"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540550    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540565    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-ovn\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540575    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540587    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce01914-1334-4916-95b5-557392e76335-sys\") pod \"node-exporter-g7q92\" (UID: \"3ce01914-1334-4916-95b5-557392e76335\") " pod="openshift-monitoring/node-exporter-g7q92"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540599    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540616    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-system-cni-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540622    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540637    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-log-socket\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540647    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540659    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-netd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540670    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.540662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540681    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-run-multus-certs\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540718    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540734    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-systemd\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540741    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540756    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-etc-sysconfig\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540783    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540801    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540804    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-systemd-units\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540816    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540838    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540851    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540856    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540869    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540875    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-cni-bin\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540891    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-var-lib-kubelet\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540897    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540896    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-etc-openvswitch\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540904    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-cnibin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540913    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-multus\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540916    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-host-kubelet\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540932    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540931    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-hostroot\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540974    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-socket-dir-parent\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.540996    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541010    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541025    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541039    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541064    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541083    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-host\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541098    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-sys\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541105    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5313f6-f18b-493a-812a-8a6fccccaf0e-hosts-file\") pod \"node-resolver-9cldl\" (UID: \"3e5313f6-f18b-493a-812a-8a6fccccaf0e\") " pod="openshift-dns/node-resolver-9cldl"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541113    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dca97178-94dc-4858-9824-06c0c0e91c03-run-systemd\") pod \"ovnkube-node-6dfn5\" (UID: \"dca97178-94dc-4858-9824-06c0c0e91c03\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541106    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-cni-bin\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541121    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541140    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541154    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541167    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541175    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-host-var-lib-kubelet\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541186    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfc49763-535f-43b4-979f-ff8d1e726222-multus-conf-dir\") pod \"multus-k5cwd\" (UID: \"cfc49763-535f-43b4-979f-ff8d1e726222\") " pod="openshift-multus/multus-k5cwd"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541201    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23577fb2-f316-4afa-bc93-fb8cd1ff75a4-run\") pod \"tuned-bx89s\" (UID: \"23577fb2-f316-4afa-bc93-fb8cd1ff75a4\") " pod="openshift-cluster-node-tuning-operator/tuned-bx89s"
Nov 02 20:15:34.542171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.541224    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c1c50dd7-2082-4b1f-bfe0-0d4568f329bb-sys-fs\") pod \"aws-ebs-csi-driver-node-5cwdt\" (UID: \"c1c50dd7-2082-4b1f-bfe0-0d4568f329bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cwdt"
Nov 02 20:15:34.715367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:34.715304    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:35.791400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:35.791361    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:15:36.075320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:36.075252    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:15:37.474402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:37.474366    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4x878"
Nov 02 20:15:38.843328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:38.843289    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:38.846884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:38.846862    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:39.107902 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:39.107829    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:15:39.929186 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:39.929153    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:39.929571 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:39.929345    5457 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 20:15:43.900878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:43.900795    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:44.005126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:44.005096    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dfn5"
Nov 02 20:15:53.805990 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:15:53.805953    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:15:53.905969 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:53.905936    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:15:58.057057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:15:58.057026    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7fcf46cb44-6pxtz"
Nov 02 20:16:00.812944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:00.812871    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-665d9fc779-6kjqm" podUID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" containerName="console" containerID="cri-o://f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9" gracePeriod=15
Nov 02 20:16:01.055035 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.055006    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:16:01.138781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.138755    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.138938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.138798    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.138938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.138820    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.138938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.138840    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.139097 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.138973    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.139097 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139071    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.139197 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139146    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.139197 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139177    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") pod \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\" (UID: \"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28\") "
Nov 02 20:16:01.139299 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139247    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:01.139299 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139264    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:01.139414 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139392    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:01.139498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139481    5457 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.139553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139503    5457 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.139553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139520    5457 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-trusted-ca-bundle\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.139553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139519    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:16:01.139718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.139539    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:01.141096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.141074    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:01.141203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.141125    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "kube-api-access-tpv5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:16:01.141203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.141134    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config" pod "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" (UID: "284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:01.240043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.240014    5457 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-oauth-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.240043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.240040    5457 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-tmp\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.240043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.240050    5457 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-oauth-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.240245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.240059    5457 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-console-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.240245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.240068    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpv5q\" (UniqueName: \"kubernetes.io/projected/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28-kube-api-access-tpv5q\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:01.314000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.313965    5457 generic.go:356] "Generic (PLEG): container finished" podID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" containerID="f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9" exitCode=0
Nov 02 20:16:01.314132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.314002    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d9fc779-6kjqm"
Nov 02 20:16:01.314132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.314021    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d9fc779-6kjqm" event={"ID":"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28","Type":"ContainerDied","Data":"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"}
Nov 02 20:16:01.314132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.314066    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d9fc779-6kjqm" event={"ID":"284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28","Type":"ContainerDied","Data":"0d231630aa960a2d76b15918ed02363de1b86e6c276a8b87d258b3ef132bfa78"}
Nov 02 20:16:01.314132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.314088    5457 scope.go:122] "RemoveContainer" containerID="f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"
Nov 02 20:16:01.321952 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.321933    5457 scope.go:122] "RemoveContainer" containerID="f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"
Nov 02 20:16:01.322212 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:01.322194    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9\": container with ID starting with f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9 not found: ID does not exist" containerID="f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"
Nov 02 20:16:01.322269 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.322219    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9"} err="failed to get container status \"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9\": rpc error: code = NotFound desc = could not find container \"f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9\": container with ID starting with f378b52afe7b70b664fa22140ee4cd4e320c37e392fcbea1796dafaf676ee1f9 not found: ID does not exist"
Nov 02 20:16:01.465651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.465570    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:16:01.471505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:01.471478    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665d9fc779-6kjqm"]
Nov 02 20:16:03.170556 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:03.170513    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" path="/var/lib/kubelet/pods/284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28/volumes"
Nov 02 20:16:04.404299 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:04.404268    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mtm8t"
Nov 02 20:16:06.052895 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.052858    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:06.053301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053247    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="alertmanager" containerID="cri-o://5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575" gracePeriod=120
Nov 02 20:16:06.053353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053298    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-metric" containerID="cri-o://b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11" gracePeriod=120
Nov 02 20:16:06.053426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053374    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="config-reloader" containerID="cri-o://c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c" gracePeriod=120
Nov 02 20:16:06.053487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053396    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy" containerID="cri-o://a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038" gracePeriod=120
Nov 02 20:16:06.053572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053379    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="prom-label-proxy" containerID="cri-o://ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35" gracePeriod=120
Nov 02 20:16:06.053635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.053609    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-web" containerID="cri-o://b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079" gracePeriod=120
Nov 02 20:16:06.077719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.077673    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dng75"
Nov 02 20:16:06.296793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.296770    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338814    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35" exitCode=0
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338837    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11" exitCode=0
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338843    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038" exitCode=0
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338849    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079" exitCode=0
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338854    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c" exitCode=0
Nov 02 20:16:06.338888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338859    5457 generic.go:356] "Generic (PLEG): container finished" podID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575" exitCode=0
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338899    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.338897    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339036    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339065    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339090    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339101    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339112    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339136    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"}
Nov 02 20:16:06.339270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.339160    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d06defd7-ffcb-4a3b-8567-82c85286ec73","Type":"ContainerDied","Data":"5cea94520fa25749e2b2e578e7b8f542571545bdc3d4e63a06d0ed3c0219620b"}
Nov 02 20:16:06.346155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.346137    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.352951 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.352926    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.359307 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.359291    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.365209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.365192    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.371573 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.371557    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.377655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377635    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.377854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377667    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.377854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377710    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.377854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377743    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.377854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377800    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377883    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.377926    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378003    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378059    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378100    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378099    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:06.378397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378139    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378162    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:16:06.378397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378172    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378234    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378281    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") pod \"d06defd7-ffcb-4a3b-8567-82c85286ec73\" (UID: \"d06defd7-ffcb-4a3b-8567-82c85286ec73\") "
Nov 02 20:16:06.378627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378505    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-metrics-client-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.378627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.378525    5457 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-main-db\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.379335 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.379278    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:06.381653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.381613    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.381653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.381640    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "kube-api-access-x4mkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:16:06.382012 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.381987    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.382105 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.382024    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:16:06.382244 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.382216    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:16:06.382328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.382244    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.383091 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.383069    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.383325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.383308    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.385303 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.385283    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.386854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.386836    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.387134 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.387112    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.387209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387144    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.387209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387168    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.387426 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.387407    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.387509 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387429    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.387509 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387443    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.387730 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.387708    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.387778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387743    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.387778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.387765    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.388033 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.388017    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.388074 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388038    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.388074 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388055    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.388290 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.388274    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.388337 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388293    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.388337 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388307    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.388521 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.388504    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.388567 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388524    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.388567 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388537    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.388864 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:06.388848    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.388921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388867    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.388921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.388879    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.389110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389088    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.389145 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389112    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.389341 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389322    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.389383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389342    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.389580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389561    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.389628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389581    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.389826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389809    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.389826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.389824    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.390051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390033    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.390051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390051    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.390286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390268    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.390331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390287    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.390507 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390489    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.390554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390508    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.390723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390705    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.390780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390724    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.390932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390913    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.390997 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.390933    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.391136 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391117    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.391179 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391136    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.391321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391302    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.391419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391322    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.391597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391578    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.391656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391599    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.391656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391643    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config" pod "d06defd7-ffcb-4a3b-8567-82c85286ec73" (UID: "d06defd7-ffcb-4a3b-8567-82c85286ec73"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:06.391851 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391832    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.391919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.391852    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.392069 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392053    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.392133 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392070    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.392282 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392263    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.392325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392283    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.392482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392466    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.392546 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392483    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.392678 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392664    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.392852 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392677    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.392940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392922    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.392975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.392941    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.393157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393141    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.393205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393157    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.393353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393336    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.393353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393352    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.393584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393565    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.393651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393586    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.393907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393888    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.393957 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.393907    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.394101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394085    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.394145 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394102    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.394285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394271    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.394285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394283    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.394490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394471    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.394530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394490    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.394669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394655    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.394750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394668    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.394924 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394908    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.394970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.394925    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.395123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395107    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.395157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395124    5457 scope.go:122] "RemoveContainer" containerID="ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"
Nov 02 20:16:06.395322 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395306    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35"} err="failed to get container status \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": rpc error: code = NotFound desc = could not find container \"ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35\": container with ID starting with ae90b4817672f7a7bc425634c552722230bead9c9b424daf5c931cd25f4c8c35 not found: ID does not exist"
Nov 02 20:16:06.395365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395323    5457 scope.go:122] "RemoveContainer" containerID="b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"
Nov 02 20:16:06.395518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395495    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11"} err="failed to get container status \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": rpc error: code = NotFound desc = could not find container \"b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11\": container with ID starting with b7cad29f338be81bb025eacd7731d5749d53e5f0936892b0d0e763c1691e8c11 not found: ID does not exist"
Nov 02 20:16:06.395557 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395520    5457 scope.go:122] "RemoveContainer" containerID="a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"
Nov 02 20:16:06.395717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395702    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038"} err="failed to get container status \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": rpc error: code = NotFound desc = could not find container \"a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038\": container with ID starting with a54d050945538e67a07b7a58220c9832fe75afefcbaffdc27743a41b59f2a038 not found: ID does not exist"
Nov 02 20:16:06.395752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395716    5457 scope.go:122] "RemoveContainer" containerID="b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"
Nov 02 20:16:06.395900 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395880    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079"} err="failed to get container status \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": rpc error: code = NotFound desc = could not find container \"b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079\": container with ID starting with b02d461746194c2229e32438ea5b370f369fde98b3f5e2a76de1f95ba9960079 not found: ID does not exist"
Nov 02 20:16:06.395940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.395901    5457 scope.go:122] "RemoveContainer" containerID="c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"
Nov 02 20:16:06.396123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.396105    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c"} err="failed to get container status \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": rpc error: code = NotFound desc = could not find container \"c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c\": container with ID starting with c4fcf008c2926b7d64c5340e9d769c6d483e006c733ce711192f632e2af2dc8c not found: ID does not exist"
Nov 02 20:16:06.396172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.396124    5457 scope.go:122] "RemoveContainer" containerID="5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"
Nov 02 20:16:06.396351 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.396334    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575"} err="failed to get container status \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": rpc error: code = NotFound desc = could not find container \"5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575\": container with ID starting with 5e03b1ad9b44ba475cd3bd2ef0ad262a46474acbbed3fb233729009eba78c575 not found: ID does not exist"
Nov 02 20:16:06.396398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.396351    5457 scope.go:122] "RemoveContainer" containerID="0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"
Nov 02 20:16:06.396549 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.396534    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61"} err="failed to get container status \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": rpc error: code = NotFound desc = could not find container \"0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61\": container with ID starting with 0ff80dc2fa43489d59cb971b0613ddfdda3f218f906ff2032c34d23342163d61 not found: ID does not exist"
Nov 02 20:16:06.479344 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479316    5457 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06defd7-ffcb-4a3b-8567-82c85286ec73-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479344 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479342    5457 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479355    5457 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-web-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479365    5457 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-out\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479374    5457 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479382    5457 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-tls-assets\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479391    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4mkl\" (UniqueName: \"kubernetes.io/projected/d06defd7-ffcb-4a3b-8567-82c85286ec73-kube-api-access-x4mkl\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479400    5457 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479409    5457 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-cluster-tls-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479417    5457 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-main-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.479542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.479425    5457 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d06defd7-ffcb-4a3b-8567-82c85286ec73-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:06.753229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.753198    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:06.757528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.757505    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:06.786486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786456    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:06.786781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786764    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-web"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786783    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-web"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786798    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="config-reloader"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786805    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="config-reloader"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786818    5457 cpu_manager.go:414] "containerMap: removing container" podUID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" containerName="console"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786826    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" containerName="console"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786845    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="prom-label-proxy"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786852    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="prom-label-proxy"
Nov 02 20:16:06.786865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786861    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-metric"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786868    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-metric"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786879    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786885    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786897    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="alertmanager"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786903    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="alertmanager"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786916    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="init-config-reloader"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786923    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="init-config-reloader"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786984    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="init-config-reloader"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.786997    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-web"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787006    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="config-reloader"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787014    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="284a1d91-f3b7-4bd2-8a2a-c1f3780f4e28" containerName="console"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787024    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="prom-label-proxy"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787032    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy-metric"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787039    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="kube-rbac-proxy"
Nov 02 20:16:06.787233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.787048    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" containerName="alertmanager"
Nov 02 20:16:06.790880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.790863    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.840329 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840299    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 02 20:16:06.840487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840331    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 02 20:16:06.840487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840333    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 02 20:16:06.840600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840550    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 02 20:16:06.840600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840565    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 02 20:16:06.840600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840587    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 02 20:16:06.840873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840605    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 02 20:16:06.840873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840865    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7zgsp\""
Nov 02 20:16:06.841041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.840869    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 02 20:16:06.841407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.841389    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 02 20:16:06.883910 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.883885    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.883919    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.883942    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884008    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-web-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884036    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884131    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884167    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884201    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884226    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stps\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-kube-api-access-8stps\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884250    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-config-out\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884279    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884301    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.884419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.884340    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.886827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.886803    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:06.985021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.984935    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.984971    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985000    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985019    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stps\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-kube-api-access-8stps\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985083    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-config-out\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985137    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985162    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985198    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985231    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985262    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985296    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985322    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-web-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985353    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.985758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985367    5457 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 20:16:06.985758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.985671    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.986103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.986032    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.986735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.986709    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b613443f-954c-450e-b10a-901c98f081ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.988542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.988518    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.988630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.988524    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.988999 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.988959    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b613443f-954c-450e-b10a-901c98f081ac-config-out\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.988999 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.988986    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.989085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.989000    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.989131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.989090    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.989131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.989099    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-web-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.989258 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.989243    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:06.989782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:06.989762    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b613443f-954c-450e-b10a-901c98f081ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:07.042408 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:07.042381    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stps\" (UniqueName: \"kubernetes.io/projected/b613443f-954c-450e-b10a-901c98f081ac-kube-api-access-8stps\") pod \"alertmanager-main-0\" (UID: \"b613443f-954c-450e-b10a-901c98f081ac\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:07.109112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:07.109073    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 20:16:07.171456 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:07.171419    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d06defd7-ffcb-4a3b-8567-82c85286ec73" path="/var/lib/kubelet/pods/d06defd7-ffcb-4a3b-8567-82c85286ec73/volumes"
Nov 02 20:16:07.525609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:07.525575    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 20:16:07.530547 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:16:07.530504    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb613443f_954c_450e_b10a_901c98f081ac.slice/crio-5dee56d050cf395f82dc2901f49cd089f9900b0c60b3b668dc8681dcbc3b0baf WatchSource:0}: Error finding container 5dee56d050cf395f82dc2901f49cd089f9900b0c60b3b668dc8681dcbc3b0baf: Status 404 returned error can't find the container with id 5dee56d050cf395f82dc2901f49cd089f9900b0c60b3b668dc8681dcbc3b0baf
Nov 02 20:16:08.348372 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:08.348339    5457 generic.go:356] "Generic (PLEG): container finished" podID="b613443f-954c-450e-b10a-901c98f081ac" containerID="5ecf74604bd29dec5342b5037145f0582fb87d1fb4ddfcf5254a11fea1a59247" exitCode=0
Nov 02 20:16:08.348737 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:08.348399    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerDied","Data":"5ecf74604bd29dec5342b5037145f0582fb87d1fb4ddfcf5254a11fea1a59247"}
Nov 02 20:16:08.348737 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:08.348455    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"5dee56d050cf395f82dc2901f49cd089f9900b0c60b3b668dc8681dcbc3b0baf"}
Nov 02 20:16:09.354922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.354887    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"2f64e54c9634050020fb94858003041d7ed6eff35e68c9921f98f9465fb24255"}
Nov 02 20:16:09.355396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.354949    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"81117ee8d1b441bf16b253e7c3436af12b0446158bab684c89313d10e77bbe8e"}
Nov 02 20:16:09.355396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.354975    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"d67ad0de6e59be583cb98aeac3daf3c5a2bd6d61a49fcecead040fea7c50f621"}
Nov 02 20:16:09.355396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.355002    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"69c202043191ee5441665e9b630e5ee1aa11d89803b9f66f4b899e6f752da962"}
Nov 02 20:16:09.355396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.355024    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"a6cda48b9a5cd95f61bf753893668ea7786ccd7329d14fd5bb814d50fb4159fd"}
Nov 02 20:16:09.355396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.355045    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b613443f-954c-450e-b10a-901c98f081ac","Type":"ContainerStarted","Data":"e298d46a4cb5f155c7d4ebdb70252a2b7d35fbaf7a3d3d5c5e771c7b454c0aa2"}
Nov 02 20:16:09.477012 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.476940    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.463734967 podStartE2EDuration="3.476926143s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.191176ms" isStatefulPod=false podCreationTimestamp="2026-11-02 20:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:16:09.47644365 +0000 UTC m=+36.414832719" watchObservedRunningTime="2026-11-02 20:16:09.476926143 +0000 UTC m=+36.415315205"
Nov 02 20:16:09.790363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.790326    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6768c54b48-zlltv"]
Nov 02 20:16:09.793163 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.793140    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.842101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.842074    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 02 20:16:09.842238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.842159    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 02 20:16:09.842238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.842219    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 02 20:16:09.842362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.842347    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 02 20:16:09.888427 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.888405    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 02 20:16:09.888539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.888487    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m7jqt\""
Nov 02 20:16:09.906526 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906495    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906540    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906591    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906695    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-serving-certs-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906731    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906760    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9g9v\" (UniqueName: \"kubernetes.io/projected/2df59077-df52-4e5c-a342-6eed4aa3b133-kube-api-access-z9g9v\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906823    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-federate-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.906889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.906863    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-metrics-client-ca\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:09.938894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.935789    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 02 20:16:09.938894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:09.936729    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6768c54b48-zlltv"]
Nov 02 20:16:10.008224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008195    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008230    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008248    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008267    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-serving-certs-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008513    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008565    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9g9v\" (UniqueName: \"kubernetes.io/projected/2df59077-df52-4e5c-a342-6eed4aa3b133-kube-api-access-z9g9v\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008607    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-federate-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.008679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008640    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-metrics-client-ca\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.009017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.008993    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-serving-certs-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.009268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.009205    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.009359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.009295    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df59077-df52-4e5c-a342-6eed4aa3b133-metrics-client-ca\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.011036 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.011013    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.011036 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.011027    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-telemeter-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.011153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.011022    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-secret-telemeter-client\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.011153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.011027    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df59077-df52-4e5c-a342-6eed4aa3b133-federate-client-tls\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.065752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.065681    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9g9v\" (UniqueName: \"kubernetes.io/projected/2df59077-df52-4e5c-a342-6eed4aa3b133-kube-api-access-z9g9v\") pod \"telemeter-client-6768c54b48-zlltv\" (UID: \"2df59077-df52-4e5c-a342-6eed4aa3b133\") " pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.108454 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.108433    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv"
Nov 02 20:16:10.521837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.521807    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6768c54b48-zlltv"]
Nov 02 20:16:10.525706 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:16:10.525657    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df59077_df52_4e5c_a342_6eed4aa3b133.slice/crio-866118f9d9f5ec14e097d6b78d5317074a0d4a5e2db1ccb8c45af6a39e66e7c5 WatchSource:0}: Error finding container 866118f9d9f5ec14e097d6b78d5317074a0d4a5e2db1ccb8c45af6a39e66e7c5: Status 404 returned error can't find the container with id 866118f9d9f5ec14e097d6b78d5317074a0d4a5e2db1ccb8c45af6a39e66e7c5
Nov 02 20:16:10.527826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:10.527809    5457 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:16:11.364377 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:11.364341    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv" event={"ID":"2df59077-df52-4e5c-a342-6eed4aa3b133","Type":"ContainerStarted","Data":"866118f9d9f5ec14e097d6b78d5317074a0d4a5e2db1ccb8c45af6a39e66e7c5"}
Nov 02 20:16:14.377734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.377675    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv" event={"ID":"2df59077-df52-4e5c-a342-6eed4aa3b133","Type":"ContainerStarted","Data":"0457ae08dac482de264d1f0ef7eb6bb5c2907f451c8abb91a647f3c254c1a46d"}
Nov 02 20:16:14.378142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.377786    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv" event={"ID":"2df59077-df52-4e5c-a342-6eed4aa3b133","Type":"ContainerStarted","Data":"3ea88c8b8266ad08b5228822a91f61a00d77bc7ea2394cb3700b1f3cab8a3b14"}
Nov 02 20:16:14.378142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.377806    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv" event={"ID":"2df59077-df52-4e5c-a342-6eed4aa3b133","Type":"ContainerStarted","Data":"d419a2eb44176f32ef3b8fbf75b48240926565374a05d044180615c645db66ac"}
Nov 02 20:16:14.588130 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.588072    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6768c54b48-zlltv" podStartSLOduration=2.248429885 podStartE2EDuration="5.58805834s" totalImagesPullingTime="3.339628455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:16:14.541311724 +0000 UTC m=+41.479700791" watchObservedRunningTime="2026-11-02 20:16:14.58805834 +0000 UTC m=+41.526447407"
Nov 02 20:16:14.979527 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.979490    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:16:14.981754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:14.981730    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.043998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.043963    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:16:15.054505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054469    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054513    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054614    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054650    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054772    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054825    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwck\" (UniqueName: \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054842    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.054875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.054859    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.155909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.155872    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.155924    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.155969    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.155991    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156023    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156049    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwck\" (UniqueName: \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156071    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156105    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156336    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156851 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156828    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156967 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156850    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.156967 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.156909    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.157074 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.157034    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.158545 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.158521    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.158632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.158617    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.213761 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.213722    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwck\" (UniqueName: \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\") pod \"console-54f55b5b66-xxldk\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") " pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.292482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.292388    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:15.671169 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:15.671129    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:16:15.675912 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:16:15.675878    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefbe19c_2a48_4a4d_948d_a4f3a19fcba2.slice/crio-e2c2cf9e1652106ac6f315cd9fa124cd9654afe3560b3736669c1ca5c754077d WatchSource:0}: Error finding container e2c2cf9e1652106ac6f315cd9fa124cd9654afe3560b3736669c1ca5c754077d: Status 404 returned error can't find the container with id e2c2cf9e1652106ac6f315cd9fa124cd9654afe3560b3736669c1ca5c754077d
Nov 02 20:16:16.385654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:16.385614    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f55b5b66-xxldk" event={"ID":"defbe19c-2a48-4a4d-948d-a4f3a19fcba2","Type":"ContainerStarted","Data":"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"}
Nov 02 20:16:16.385885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:16.385679    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f55b5b66-xxldk" event={"ID":"defbe19c-2a48-4a4d-948d-a4f3a19fcba2","Type":"ContainerStarted","Data":"e2c2cf9e1652106ac6f315cd9fa124cd9654afe3560b3736669c1ca5c754077d"}
Nov 02 20:16:16.496569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:16.496516    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-54f55b5b66-xxldk" podStartSLOduration=2.4964990240000002 podStartE2EDuration="2.496499024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:16:16.496344132 +0000 UTC m=+43.434733203" watchObservedRunningTime="2026-11-02 20:16:16.496499024 +0000 UTC m=+43.434888077"
Nov 02 20:16:23.807341 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:23.807302    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:16:25.293325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:25.293270    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:25.293325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:25.293340    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:25.298134 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:25.298114    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:25.418522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:25.418494    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:16:25.560091 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:25.560012    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:16:50.580213 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.580149    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5f757d487-2j98h" podUID="7329985d-9aae-4933-972a-6f854d133528" containerName="console" containerID="cri-o://ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351" gracePeriod=15
Nov 02 20:16:50.829859 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.829831    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:16:50.926204 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926170    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926251    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926279    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926303    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926324    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926341    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926382    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926427    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") pod \"7329985d-9aae-4933-972a-6f854d133528\" (UID: \"7329985d-9aae-4933-972a-6f854d133528\") "
Nov 02 20:16:50.926609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926567    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:16:50.926806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926726    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:50.926953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926926    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:50.927031 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926967    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:50.927031 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.926990    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:16:50.928606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.928580    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:50.928732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.928619    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:16:50.928732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:50.928625    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh" pod "7329985d-9aae-4933-972a-6f854d133528" (UID: "7329985d-9aae-4933-972a-6f854d133528"). InnerVolumeSpecName "kube-api-access-g92xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:16:51.027259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027220    5457 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7329985d-9aae-4933-972a-6f854d133528-tmp\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027259    5457 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-trusted-ca-bundle\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027270    5457 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027510 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027279    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g92xh\" (UniqueName: \"kubernetes.io/projected/7329985d-9aae-4933-972a-6f854d133528-kube-api-access-g92xh\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027510 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027291    5457 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027510 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027300    5457 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-console-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027510 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027311    5457 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7329985d-9aae-4933-972a-6f854d133528-oauth-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.027510 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.027322    5457 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7329985d-9aae-4933-972a-6f854d133528-console-oauth-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:16:51.501260 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.501174    5457 generic.go:356] "Generic (PLEG): container finished" podID="7329985d-9aae-4933-972a-6f854d133528" containerID="ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351" exitCode=0
Nov 02 20:16:51.501260 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.501219    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f757d487-2j98h" event={"ID":"7329985d-9aae-4933-972a-6f854d133528","Type":"ContainerDied","Data":"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"}
Nov 02 20:16:51.501443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.501263    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f757d487-2j98h" event={"ID":"7329985d-9aae-4933-972a-6f854d133528","Type":"ContainerDied","Data":"8588218db82911bde018bb095d908c9e87e6c5f489455a05d2d48eee44039433"}
Nov 02 20:16:51.501443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.501284    5457 scope.go:122] "RemoveContainer" containerID="ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"
Nov 02 20:16:51.501443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.501225    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f757d487-2j98h"
Nov 02 20:16:51.510450 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.509563    5457 scope.go:122] "RemoveContainer" containerID="ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"
Nov 02 20:16:51.510450 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:51.509942    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351\": container with ID starting with ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351 not found: ID does not exist" containerID="ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"
Nov 02 20:16:51.510450 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.509974    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351"} err="failed to get container status \"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351\": rpc error: code = NotFound desc = could not find container \"ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351\": container with ID starting with ef08a430cd121c59d545a17da134e740c2ee3eb3054c793b0e50210b8002a351 not found: ID does not exist"
Nov 02 20:16:51.653707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.653653    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:16:51.699801 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:51.699770    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f757d487-2j98h"]
Nov 02 20:16:53.172050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:16:53.172021    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7329985d-9aae-4933-972a-6f854d133528" path="/var/lib/kubelet/pods/7329985d-9aae-4933-972a-6f854d133528/volumes"
Nov 02 20:16:53.806775 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:16:53.806733    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:17:23.806861 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:17:23.806782    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:17:47.844669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.844629    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccd8987d7-v4smg"]
Nov 02 20:17:47.845201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.845084    5457 cpu_manager.go:414] "containerMap: removing container" podUID="7329985d-9aae-4933-972a-6f854d133528" containerName="console"
Nov 02 20:17:47.845201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.845104    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7329985d-9aae-4933-972a-6f854d133528" containerName="console"
Nov 02 20:17:47.845201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.845184    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="7329985d-9aae-4933-972a-6f854d133528" containerName="console"
Nov 02 20:17:47.848229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.848210    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859478    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-trusted-ca-bundle\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859522    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11022f8a-6b0e-4933-9248-671288a856f9-tmp\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859541    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-service-ca\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859649    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-oauth-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859707    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5pjc\" (UniqueName: \"kubernetes.io/projected/11022f8a-6b0e-4933-9248-671288a856f9-kube-api-access-p5pjc\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859760    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-console-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859844    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-oauth-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.859930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.859915    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.949247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.949216    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccd8987d7-v4smg"]
Nov 02 20:17:47.960985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.960959    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-trusted-ca-bundle\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.960994    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11022f8a-6b0e-4933-9248-671288a856f9-tmp\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961013    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-service-ca\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961045    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-oauth-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961067    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5pjc\" (UniqueName: \"kubernetes.io/projected/11022f8a-6b0e-4933-9248-671288a856f9-kube-api-access-p5pjc\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961087    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-console-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961123    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-oauth-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961155    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961524 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961467    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11022f8a-6b0e-4933-9248-671288a856f9-tmp\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961973    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-service-ca\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.961998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.961973    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-oauth-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.962174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.962043    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-console-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.962232 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.962206    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11022f8a-6b0e-4933-9248-671288a856f9-trusted-ca-bundle\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.963659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.963622    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-oauth-config\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:47.963762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:47.963746    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11022f8a-6b0e-4933-9248-671288a856f9-console-serving-cert\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:48.018176 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.018147    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5pjc\" (UniqueName: \"kubernetes.io/projected/11022f8a-6b0e-4933-9248-671288a856f9-kube-api-access-p5pjc\") pod \"console-6ccd8987d7-v4smg\" (UID: \"11022f8a-6b0e-4933-9248-671288a856f9\") " pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:48.162818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.162785    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:48.573992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.573914    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccd8987d7-v4smg"]
Nov 02 20:17:48.577389 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:17:48.577336    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11022f8a_6b0e_4933_9248_671288a856f9.slice/crio-260c00ee13ac2facd014d62d7c919112479cbbee2a8c7926c0280233bcb06f37 WatchSource:0}: Error finding container 260c00ee13ac2facd014d62d7c919112479cbbee2a8c7926c0280233bcb06f37: Status 404 returned error can't find the container with id 260c00ee13ac2facd014d62d7c919112479cbbee2a8c7926c0280233bcb06f37
Nov 02 20:17:48.688720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.688257    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd8987d7-v4smg" event={"ID":"11022f8a-6b0e-4933-9248-671288a856f9","Type":"ContainerStarted","Data":"7224428f3816a525ce7c7bd8a0b8182d9f1963638b0fb0e38a3b7ddd8e75d224"}
Nov 02 20:17:48.688720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.688325    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd8987d7-v4smg" event={"ID":"11022f8a-6b0e-4933-9248-671288a856f9","Type":"ContainerStarted","Data":"260c00ee13ac2facd014d62d7c919112479cbbee2a8c7926c0280233bcb06f37"}
Nov 02 20:17:48.800296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:48.799957    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6ccd8987d7-v4smg" podStartSLOduration=1.7999349260000002 podStartE2EDuration="1.799934926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:17:48.79918047 +0000 UTC m=+135.737569539" watchObservedRunningTime="2026-11-02 20:17:48.799934926 +0000 UTC m=+135.738323994"
Nov 02 20:17:53.806499 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:17:53.806459    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:17:58.163187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:58.163152    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:58.163586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:58.163210    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:58.168600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:58.168574    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:58.724737 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:58.724712    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ccd8987d7-v4smg"
Nov 02 20:17:58.882646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:17:58.882609    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:18:23.806677 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:18:23.806638    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:18:23.901633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:23.901572    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-54f55b5b66-xxldk" podUID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" containerName="console" containerID="cri-o://a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d" gracePeriod=15
Nov 02 20:18:24.131127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.131103    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:18:24.237988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.237941    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238010    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238040    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238063    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238096    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\" (UniqueName: \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238134    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\" (UniqueName: \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238201    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238256    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\") pod \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\" (UID: \"defbe19c-2a48-4a4d-948d-a4f3a19fcba2\") "
Nov 02 20:18:24.238521 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238478    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:18:24.238574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238516    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:18:24.238574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238527    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:18:24.238574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238535    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:18:24.238802 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.238774    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:18:24.240277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.240253    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:18:24.240405 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.240386    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:18:24.240452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.240408    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck" pod "defbe19c-2a48-4a4d-948d-a4f3a19fcba2" (UID: "defbe19c-2a48-4a4d-948d-a4f3a19fcba2"). InnerVolumeSpecName "kube-api-access-xvwck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339152    5457 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339184    5457 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-oauth-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339193    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvwck\" (UniqueName: \"kubernetes.io/projected/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-kube-api-access-xvwck\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339202    5457 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-tmp\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339211    5457 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339220    5457 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-oauth-config\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339229    5457 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-console-serving-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.339236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.339238    5457 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defbe19c-2a48-4a4d-948d-a4f3a19fcba2-trusted-ca-bundle\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:18:24.807378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.807347    5457 generic.go:356] "Generic (PLEG): container finished" podID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" containerID="a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d" exitCode=0
Nov 02 20:18:24.807823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.807386    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f55b5b66-xxldk" event={"ID":"defbe19c-2a48-4a4d-948d-a4f3a19fcba2","Type":"ContainerDied","Data":"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"}
Nov 02 20:18:24.807823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.807393    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f55b5b66-xxldk"
Nov 02 20:18:24.807823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.807424    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f55b5b66-xxldk" event={"ID":"defbe19c-2a48-4a4d-948d-a4f3a19fcba2","Type":"ContainerDied","Data":"e2c2cf9e1652106ac6f315cd9fa124cd9654afe3560b3736669c1ca5c754077d"}
Nov 02 20:18:24.807823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.807445    5457 scope.go:122] "RemoveContainer" containerID="a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"
Nov 02 20:18:24.815941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.815924    5457 scope.go:122] "RemoveContainer" containerID="a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"
Nov 02 20:18:24.816207 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:18:24.816190    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d\": container with ID starting with a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d not found: ID does not exist" containerID="a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"
Nov 02 20:18:24.816257 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.816217    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d"} err="failed to get container status \"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d\": rpc error: code = NotFound desc = could not find container \"a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d\": container with ID starting with a5f5c25e11d3e7944d7fed0903de14831532143aa203a1f28db7997e4eb3df9d not found: ID does not exist"
Nov 02 20:18:24.960130 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:24.960101    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:18:25.006377 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:25.006345    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f55b5b66-xxldk"]
Nov 02 20:18:25.170415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:18:25.170387    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" path="/var/lib/kubelet/pods/defbe19c-2a48-4a4d-948d-a4f3a19fcba2/volumes"
Nov 02 20:18:53.807261 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:18:53.807179    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:19:23.806570 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:19:23.806532    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:19:26.900786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.900748    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"]
Nov 02 20:19:26.901196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.901087    5457 cpu_manager.go:414] "containerMap: removing container" podUID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" containerName="console"
Nov 02 20:19:26.901196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.901103    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" containerName="console"
Nov 02 20:19:26.901196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.901153    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="defbe19c-2a48-4a4d-948d-a4f3a19fcba2" containerName="console"
Nov 02 20:19:26.904038 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.904020    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:26.955334 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.955305    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 02 20:19:26.998027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.997992    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:26.998181 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.998038    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:26.998181 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:26.998140    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5g4p\" (UniqueName: \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.001564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.001541    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 02 20:19:27.001670 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.001615    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-n7rbf\""
Nov 02 20:19:27.002209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.002187    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"]
Nov 02 20:19:27.099292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.099248    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.099292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.099291    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.099560 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.099319    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5g4p\" (UniqueName: \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.099757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.099732    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.099840 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.099793    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.157068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.156998    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5g4p\" (UniqueName: \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.218641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.218602    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:27.347232 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.347196    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:19:27.350512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.350492    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.401979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.401948    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.401979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.401982    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402198 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.401998    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402198 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402054    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402198 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402183    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402244    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402274    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.402807 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402786    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 20:19:27.402922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402833    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 02 20:19:27.402922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402835    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 02 20:19:27.402922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402866    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 02 20:19:27.402922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402918    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qhb9c\""
Nov 02 20:19:27.403072 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402936    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 20:19:27.403072 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.402943    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 02 20:19:27.420371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.417780    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:19:27.503054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503020    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503060    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503081    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503105    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503141    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503186    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503211    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.503773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.503751    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.505477 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.505441    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.505561 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.505498    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.505663 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.505647    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.505827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.505808    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.560493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.560464    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.560623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.560492    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\") pod \"istiod-openshift-gateway-7876bfcb74-7s9t7\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:27.582195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.582164    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"]
Nov 02 20:19:27.585796 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:19:27.585765    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22019a7a_6fd4_43aa_a694_109ccb671383.slice/crio-ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a WatchSource:0}: Error finding container ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a: Status 404 returned error can't find the container with id ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a
Nov 02 20:19:27.661917 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:27.661880    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:28.017080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:28.016995    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerStarted","Data":"ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a"}
Nov 02 20:19:28.074415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:28.074382    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:19:28.077919 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:19:28.077888    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8e716f_0b5e_452e_bda1_47308e173ee6.slice/crio-4ef1fb10ce5f17b9aecca949013c4fad3877680b81cc6f67b470e5c784543db0 WatchSource:0}: Error finding container 4ef1fb10ce5f17b9aecca949013c4fad3877680b81cc6f67b470e5c784543db0: Status 404 returned error can't find the container with id 4ef1fb10ce5f17b9aecca949013c4fad3877680b81cc6f67b470e5c784543db0
Nov 02 20:19:29.021636 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:29.021591    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" event={"ID":"1a8e716f-0b5e-452e-bda1-47308e173ee6","Type":"ContainerStarted","Data":"4ef1fb10ce5f17b9aecca949013c4fad3877680b81cc6f67b470e5c784543db0"}
Nov 02 20:19:33.271274 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:33.271248    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:19:33.271518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:33.271306    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:19:34.042608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:34.042562    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" event={"ID":"1a8e716f-0b5e-452e-bda1-47308e173ee6","Type":"ContainerStarted","Data":"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"}
Nov 02 20:19:34.042794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:34.042713    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:34.044336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:34.044306    5457 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-7s9t7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:19:34.044440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:34.044360    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:19:34.234792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:34.234739    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" podStartSLOduration=2.04396647 podStartE2EDuration="7.234723531s" totalImagesPullingTime="5.190757061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:19:34.200475764 +0000 UTC m=+241.138864845" watchObservedRunningTime="2026-11-02 20:19:34.234723531 +0000 UTC m=+241.173112599"
Nov 02 20:19:35.047011 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:35.046979    5457 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-7s9t7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:19:35.047456 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:35.047036    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:19:38.047270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:38.047241    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:19:40.063582 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:40.063539    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerStarted","Data":"d5681dbd751ae0465ca075dfaffd04506188dc526d971fb4da83f7305fadb6a4"}
Nov 02 20:19:41.068380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:41.068346    5457 generic.go:356] "Generic (PLEG): container finished" podID="22019a7a-6fd4-43aa-a694-109ccb671383" containerID="d5681dbd751ae0465ca075dfaffd04506188dc526d971fb4da83f7305fadb6a4" exitCode=0
Nov 02 20:19:41.068794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:41.068429    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerDied","Data":"d5681dbd751ae0465ca075dfaffd04506188dc526d971fb4da83f7305fadb6a4"}
Nov 02 20:19:45.084554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:45.084521    5457 generic.go:356] "Generic (PLEG): container finished" podID="22019a7a-6fd4-43aa-a694-109ccb671383" containerID="76b8959c255867fca12b3016b2a9268e388dc4a7ebbdc101df0ad885df224cec" exitCode=0
Nov 02 20:19:45.084977 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:45.084610    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerDied","Data":"76b8959c255867fca12b3016b2a9268e388dc4a7ebbdc101df0ad885df224cec"}
Nov 02 20:19:52.112359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:52.112277    5457 generic.go:356] "Generic (PLEG): container finished" podID="22019a7a-6fd4-43aa-a694-109ccb671383" containerID="f8d9bfcff5da071b12016e70a5e620f27a46eb5043d2c8e5678e06c70de5777c" exitCode=0
Nov 02 20:19:52.112359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:52.112344    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerDied","Data":"f8d9bfcff5da071b12016e70a5e620f27a46eb5043d2c8e5678e06c70de5777c"}
Nov 02 20:19:53.247882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.247860    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:53.334001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.333973    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\" (UniqueName: \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\") pod \"22019a7a-6fd4-43aa-a694-109ccb671383\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") "
Nov 02 20:19:53.334167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.334050    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\") pod \"22019a7a-6fd4-43aa-a694-109ccb671383\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") "
Nov 02 20:19:53.334167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.334108    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\") pod \"22019a7a-6fd4-43aa-a694-109ccb671383\" (UID: \"22019a7a-6fd4-43aa-a694-109ccb671383\") "
Nov 02 20:19:53.334473 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.334448    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle" pod "22019a7a-6fd4-43aa-a694-109ccb671383" (UID: "22019a7a-6fd4-43aa-a694-109ccb671383"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:19:53.336639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.336611    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p" pod "22019a7a-6fd4-43aa-a694-109ccb671383" (UID: "22019a7a-6fd4-43aa-a694-109ccb671383"). InnerVolumeSpecName "kube-api-access-v5g4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:19:53.338847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.338815    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util" pod "22019a7a-6fd4-43aa-a694-109ccb671383" (UID: "22019a7a-6fd4-43aa-a694-109ccb671383"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:19:53.435033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.435006    5457 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-bundle\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:19:53.435033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.435030    5457 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22019a7a-6fd4-43aa-a694-109ccb671383-util\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:19:53.435033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:53.435039    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5g4p\" (UniqueName: \"kubernetes.io/projected/22019a7a-6fd4-43aa-a694-109ccb671383-kube-api-access-v5g4p\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:19:53.807263 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:19:53.807182    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:19:54.121418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:54.121333    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc" event={"ID":"22019a7a-6fd4-43aa-a694-109ccb671383","Type":"ContainerDied","Data":"ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a"}
Nov 02 20:19:54.121418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:54.121361    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644g4pcc"
Nov 02 20:19:54.121418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:19:54.121378    5457 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec1ba520d463cb0a431e40d17c896d58098831d9332b409ccca5e16d2640002a"
Nov 02 20:20:18.940707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940620    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"]
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940922    5457 cpu_manager.go:414] "containerMap: removing container" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="pull"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940933    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="pull"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940947    5457 cpu_manager.go:414] "containerMap: removing container" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="util"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940952    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="util"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940963    5457 cpu_manager.go:414] "containerMap: removing container" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="extract"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.940968    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="extract"
Nov 02 20:20:18.941140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.941009    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="22019a7a-6fd4-43aa-a694-109ccb671383" containerName="extract"
Nov 02 20:20:18.943167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:18.943146    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013049    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-tmp\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013092    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvvh\" (UniqueName: \"kubernetes.io/projected/4b52aef5-c35c-41b3-b56c-a8ee23c63512-kube-api-access-7rvvh\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013118    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-manifests\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013167    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-metrics-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013429 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013267    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-webhook-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.013429 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.013303    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.061347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061308    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 02 20:20:19.061597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061360    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 02 20:20:19.061597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061414    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 02 20:20:19.061597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061420    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 02 20:20:19.061780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061665    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-72vcs\""
Nov 02 20:20:19.061780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.061708    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 02 20:20:19.114218 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114186    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-tmp\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114225    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvvh\" (UniqueName: \"kubernetes.io/projected/4b52aef5-c35c-41b3-b56c-a8ee23c63512-kube-api-access-7rvvh\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114347    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-manifests\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114392    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-metrics-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114431    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-webhook-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114461    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.114884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.114849    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-manifests\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.116467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.116439    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b52aef5-c35c-41b3-b56c-a8ee23c63512-tmp\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.116894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.116877    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-metrics-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.116943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.116906    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.116980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.116906    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b52aef5-c35c-41b3-b56c-a8ee23c63512-webhook-cert\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.177658 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.177627    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvvh\" (UniqueName: \"kubernetes.io/projected/4b52aef5-c35c-41b3-b56c-a8ee23c63512-kube-api-access-7rvvh\") pod \"opendatahub-operator-controller-manager-5984b9787d-6c2sr\" (UID: \"4b52aef5-c35c-41b3-b56c-a8ee23c63512\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.182546 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.182511    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"]
Nov 02 20:20:19.255914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.255827    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:19.733134 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:19.733101    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"]
Nov 02 20:20:19.736324 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:20:19.736296    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b52aef5_c35c_41b3_b56c_a8ee23c63512.slice/crio-850220f073676672deaa9965d1bc38aacb6385d8a922e1c9b4c1d0e977a49b6d WatchSource:0}: Error finding container 850220f073676672deaa9965d1bc38aacb6385d8a922e1c9b4c1d0e977a49b6d: Status 404 returned error can't find the container with id 850220f073676672deaa9965d1bc38aacb6385d8a922e1c9b4c1d0e977a49b6d
Nov 02 20:20:20.208646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:20.208602    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr" event={"ID":"4b52aef5-c35c-41b3-b56c-a8ee23c63512","Type":"ContainerStarted","Data":"850220f073676672deaa9965d1bc38aacb6385d8a922e1c9b4c1d0e977a49b6d"}
Nov 02 20:20:23.807850 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:20:23.807823    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:20:24.226235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:24.226197    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr" event={"ID":"4b52aef5-c35c-41b3-b56c-a8ee23c63512","Type":"ContainerStarted","Data":"ca005705615025cfaca62593d6c65c14dfac78efe075690be68b83c1b841e0ed"}
Nov 02 20:20:25.231057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:25.231019    5457 generic.go:356] "Generic (PLEG): container finished" podID="4b52aef5-c35c-41b3-b56c-a8ee23c63512" containerID="ca005705615025cfaca62593d6c65c14dfac78efe075690be68b83c1b841e0ed" exitCode=0
Nov 02 20:20:25.231545 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:25.231078    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr" event={"ID":"4b52aef5-c35c-41b3-b56c-a8ee23c63512","Type":"ContainerDied","Data":"ca005705615025cfaca62593d6c65c14dfac78efe075690be68b83c1b841e0ed"}
Nov 02 20:20:27.239795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:27.239765    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr" event={"ID":"4b52aef5-c35c-41b3-b56c-a8ee23c63512","Type":"ContainerStarted","Data":"d6ca55c964c85eb04b4c53941d3caeda9ef4f32b0c5eefb24362ebd331dde949"}
Nov 02 20:20:27.240188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:27.239881    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:27.510228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:27.510108    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr" podStartSLOduration=3.954898033 podStartE2EDuration="9.510092856s" totalImagesPullingTime="5.086030884s" totalInitContainerRuntime="469.163939ms" isStatefulPod=false podCreationTimestamp="2026-11-02 20:20:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:20:27.463440834 +0000 UTC m=+294.401829912" watchObservedRunningTime="2026-11-02 20:20:27.510092856 +0000 UTC m=+294.448481925"
Nov 02 20:20:33.200724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:33.200678    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:20:33.201153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:33.200974    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:20:38.245420 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:38.245379    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5984b9787d-6c2sr"
Nov 02 20:20:44.674729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.674668    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"]
Nov 02 20:20:44.676884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.676868    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.773262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.773234    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j5pbt\""
Nov 02 20:20:44.773262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.773233    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 02 20:20:44.773262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.773233    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 02 20:20:44.774181 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.774156    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"]
Nov 02 20:20:44.811097 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.811065    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgts4\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-kube-api-access-dgts4\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.811231 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.811129    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.912217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.912181    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgts4\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-kube-api-access-dgts4\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.912353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.912235    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.969891 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.969833    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.969987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.969882    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgts4\" (UniqueName: \"kubernetes.io/projected/816b26d1-f838-41d4-9177-6c5d9ca2fcb0-kube-api-access-dgts4\") pod \"cert-manager-cainjector-5c57bbd4fc-bkcvl\" (UID: \"816b26d1-f838-41d4-9177-6c5d9ca2fcb0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:44.996787 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:44.996768    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"
Nov 02 20:20:45.363133 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:45.363036    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl"]
Nov 02 20:20:45.367846 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:20:45.367811    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod816b26d1_f838_41d4_9177_6c5d9ca2fcb0.slice/crio-b71c268e8da1ddb6fdee60e7666b7baf41e6a1a067df5c0fcb8a997e4199d2ce WatchSource:0}: Error finding container b71c268e8da1ddb6fdee60e7666b7baf41e6a1a067df5c0fcb8a997e4199d2ce: Status 404 returned error can't find the container with id b71c268e8da1ddb6fdee60e7666b7baf41e6a1a067df5c0fcb8a997e4199d2ce
Nov 02 20:20:46.305726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:46.305677    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl" event={"ID":"816b26d1-f838-41d4-9177-6c5d9ca2fcb0","Type":"ContainerStarted","Data":"b71c268e8da1ddb6fdee60e7666b7baf41e6a1a067df5c0fcb8a997e4199d2ce"}
Nov 02 20:20:49.856425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.856348    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"]
Nov 02 20:20:49.858631 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.858607    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:49.907241 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.907218    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 02 20:20:49.953355 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.953334    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 02 20:20:49.953551 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.953359    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 02 20:20:49.953551 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.953358    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 02 20:20:49.953551 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.953377    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4x2wt\""
Nov 02 20:20:49.954356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.954333    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"]
Nov 02 20:20:49.956641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.956625    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbhs\" (UniqueName: \"kubernetes.io/projected/5087ca73-7f57-45bc-84e8-a54ff65afa89-kube-api-access-gnbhs\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:49.956719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.956656    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5087ca73-7f57-45bc-84e8-a54ff65afa89-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:49.956719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:49.956677    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.057480 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.057418    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.057671 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.057548    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbhs\" (UniqueName: \"kubernetes.io/projected/5087ca73-7f57-45bc-84e8-a54ff65afa89-kube-api-access-gnbhs\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.057671 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:20:50.057594    5457 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Nov 02 20:20:50.057834 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:20:50.057672    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert podName:5087ca73-7f57-45bc-84e8-a54ff65afa89 nodeName:}" failed. No retries permitted until 2026-11-02 20:20:50.557650011 +0000 UTC m=+317.496039077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert") pod "kuadrant-console-plugin-66c4fb575d-5rpxb" (UID: "5087ca73-7f57-45bc-84e8-a54ff65afa89") : secret "plugin-serving-cert" not found
Nov 02 20:20:50.057834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.057595    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5087ca73-7f57-45bc-84e8-a54ff65afa89-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.058324 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.058273    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5087ca73-7f57-45bc-84e8-a54ff65afa89-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.114706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.114614    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbhs\" (UniqueName: \"kubernetes.io/projected/5087ca73-7f57-45bc-84e8-a54ff65afa89-kube-api-access-gnbhs\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.324163 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.324124    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl" event={"ID":"816b26d1-f838-41d4-9177-6c5d9ca2fcb0","Type":"ContainerStarted","Data":"67c6afea771c8f55306f71c2b4b4d25863c4fbdf83831eb6f3e7a3ca9c55a8ae"}
Nov 02 20:20:50.431788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.431723    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-bkcvl" podStartSLOduration=2.319741259 podStartE2EDuration="6.431678452s" totalImagesPullingTime="4.111937193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:20:50.430431459 +0000 UTC m=+317.368820528" watchObservedRunningTime="2026-11-02 20:20:50.431678452 +0000 UTC m=+317.370067522"
Nov 02 20:20:50.563428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.563379    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.565680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.565647    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5087ca73-7f57-45bc-84e8-a54ff65afa89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-5rpxb\" (UID: \"5087ca73-7f57-45bc-84e8-a54ff65afa89\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:50.769206 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:50.769120    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"
Nov 02 20:20:51.138798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:51.138765    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb"]
Nov 02 20:20:51.142672 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:20:51.142629    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5087ca73_7f57_45bc_84e8_a54ff65afa89.slice/crio-bbc42971da6b7b4febfd839b077ad6e21f1bb6377dc9fcbe0df54d8364f8a7aa WatchSource:0}: Error finding container bbc42971da6b7b4febfd839b077ad6e21f1bb6377dc9fcbe0df54d8364f8a7aa: Status 404 returned error can't find the container with id bbc42971da6b7b4febfd839b077ad6e21f1bb6377dc9fcbe0df54d8364f8a7aa
Nov 02 20:20:51.329161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:51.329127    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb" event={"ID":"5087ca73-7f57-45bc-84e8-a54ff65afa89","Type":"ContainerStarted","Data":"bbc42971da6b7b4febfd839b077ad6e21f1bb6377dc9fcbe0df54d8364f8a7aa"}
Nov 02 20:20:53.171518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.171465    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"]
Nov 02 20:20:53.177359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.177333    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.233997 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.233916    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"]
Nov 02 20:20:53.276112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.276066    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 02 20:20:53.276275 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.276216    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 02 20:20:53.276347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.276335    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4bpw7\""
Nov 02 20:20:53.286927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.286891    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tls-certs\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.287079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.287024    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvr9\" (UniqueName: \"kubernetes.io/projected/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-kube-api-access-8rvr9\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.287519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.287208    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tmp\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.388699 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.388657    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tls-certs\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.388887 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.388734    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvr9\" (UniqueName: \"kubernetes.io/projected/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-kube-api-access-8rvr9\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.388887 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.388781    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tmp\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.391794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.391767    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tmp\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.391928 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.391837    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-tls-certs\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.446830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.446749    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvr9\" (UniqueName: \"kubernetes.io/projected/7d1641d0-15a1-4825-a2d8-eaffa63f9a52-kube-api-access-8rvr9\") pod \"kube-auth-proxy-676d5b6d89-86tzj\" (UID: \"7d1641d0-15a1-4825-a2d8-eaffa63f9a52\") " pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.501576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.501538    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"
Nov 02 20:20:53.825700 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:20:53.825564    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:20:53.895371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:53.895280    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj"]
Nov 02 20:20:53.901662 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:20:53.901634    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1641d0_15a1_4825_a2d8_eaffa63f9a52.slice/crio-f0b4c5186d2fa8674201611d39a48db45924493999ee7f35d82c04b891d4541e WatchSource:0}: Error finding container f0b4c5186d2fa8674201611d39a48db45924493999ee7f35d82c04b891d4541e: Status 404 returned error can't find the container with id f0b4c5186d2fa8674201611d39a48db45924493999ee7f35d82c04b891d4541e
Nov 02 20:20:54.344267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:54.344231    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj" event={"ID":"7d1641d0-15a1-4825-a2d8-eaffa63f9a52","Type":"ContainerStarted","Data":"f0b4c5186d2fa8674201611d39a48db45924493999ee7f35d82c04b891d4541e"}
Nov 02 20:20:57.357877 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:57.357844    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb" event={"ID":"5087ca73-7f57-45bc-84e8-a54ff65afa89","Type":"ContainerStarted","Data":"d21ecde6f50eec93de26936e5d99481bcfd6a65521e02be9cc4ffd5ff642010c"}
Nov 02 20:20:57.359351 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:57.359327    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj" event={"ID":"7d1641d0-15a1-4825-a2d8-eaffa63f9a52","Type":"ContainerStarted","Data":"e08c914941a50d83b0e27d5d042b23fb3f46bde7d98fb42c3167f469bd517202"}
Nov 02 20:20:57.478559 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:57.478502    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-5rpxb" podStartSLOduration=2.344880218 podStartE2EDuration="8.478489406s" totalImagesPullingTime="6.133609188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:20:57.478032886 +0000 UTC m=+324.416421968" watchObservedRunningTime="2026-11-02 20:20:57.478489406 +0000 UTC m=+324.416878475"
Nov 02 20:20:57.622837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:57.622734    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-676d5b6d89-86tzj" podStartSLOduration=1.510413873 podStartE2EDuration="4.622717685s" totalImagesPullingTime="3.112303812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:20:57.621755978 +0000 UTC m=+324.560145046" watchObservedRunningTime="2026-11-02 20:20:57.622717685 +0000 UTC m=+324.561106758"
Nov 02 20:20:59.095762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.095727    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:20:59.098890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.098870    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.147415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.147389    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 02 20:20:59.156943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.156912    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:20:59.238642 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.238608    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnqp9\" (UniqueName: \"kubernetes.io/projected/6cab00ec-88da-432a-82ae-a514dde0aa99-kube-api-access-gnqp9\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.238846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.238652    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cab00ec-88da-432a-82ae-a514dde0aa99-config-file\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.339612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.339575    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnqp9\" (UniqueName: \"kubernetes.io/projected/6cab00ec-88da-432a-82ae-a514dde0aa99-kube-api-access-gnqp9\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.339767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.339620    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cab00ec-88da-432a-82ae-a514dde0aa99-config-file\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.340276 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.340256    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cab00ec-88da-432a-82ae-a514dde0aa99-config-file\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.397052 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.397026    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:20:59.397221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.397201    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnqp9\" (UniqueName: \"kubernetes.io/projected/6cab00ec-88da-432a-82ae-a514dde0aa99-kube-api-access-gnqp9\") pod \"limitador-limitador-7c9b87d574-nd227\" (UID: \"6cab00ec-88da-432a-82ae-a514dde0aa99\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.411015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.410993    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:20:59.771620 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:20:59.771532    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:20:59.775133 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:20:59.775103    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cab00ec_88da_432a_82ae_a514dde0aa99.slice/crio-a1fe8f21e49ab29e6f6d4027be5371807fc546e02610e3830b67a3462723c26e WatchSource:0}: Error finding container a1fe8f21e49ab29e6f6d4027be5371807fc546e02610e3830b67a3462723c26e: Status 404 returned error can't find the container with id a1fe8f21e49ab29e6f6d4027be5371807fc546e02610e3830b67a3462723c26e
Nov 02 20:21:00.373432 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:00.373391    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227" event={"ID":"6cab00ec-88da-432a-82ae-a514dde0aa99","Type":"ContainerStarted","Data":"a1fe8f21e49ab29e6f6d4027be5371807fc546e02610e3830b67a3462723c26e"}
Nov 02 20:21:03.387221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:03.387181    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227" event={"ID":"6cab00ec-88da-432a-82ae-a514dde0aa99","Type":"ContainerStarted","Data":"854f076884fffc35dc9d01ebc730501e7884589625e03545be854863875c9cdb"}
Nov 02 20:21:03.387600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:03.387327    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:21:03.495965 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:03.495859    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227" podStartSLOduration=1.488547396 podStartE2EDuration="4.495845432s" totalImagesPullingTime="3.007298036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:21:03.495533194 +0000 UTC m=+330.433922273" watchObservedRunningTime="2026-11-02 20:21:03.495845432 +0000 UTC m=+330.434234500"
Nov 02 20:21:14.393167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:14.393135    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-nd227"
Nov 02 20:21:18.764118 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.764082    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:18.767355 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.767331    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:18.797936 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.797904    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7j7\" (UniqueName: \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\") pod \"authorino-57f7f8659f-sdqkr\" (UID: \"a05af856-12ee-4e8d-b63a-6114058adb41\") " pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:18.816009 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.815984    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gvxgg\""
Nov 02 20:21:18.863052 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.863018    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:18.899085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.899056    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7j7\" (UniqueName: \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\") pod \"authorino-57f7f8659f-sdqkr\" (UID: \"a05af856-12ee-4e8d-b63a-6114058adb41\") " pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:18.955984 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:18.955954    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7j7\" (UniqueName: \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\") pod \"authorino-57f7f8659f-sdqkr\" (UID: \"a05af856-12ee-4e8d-b63a-6114058adb41\") " pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:19.078160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:19.078071    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:19.449159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:19.449119    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:19.453400 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:21:19.453372    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda05af856_12ee_4e8d_b63a_6114058adb41.slice/crio-acb0bbee4e9af10a7c2fdebbebbc0fd23ac751270bd546b6d6fc67598b0ae357 WatchSource:0}: Error finding container acb0bbee4e9af10a7c2fdebbebbc0fd23ac751270bd546b6d6fc67598b0ae357: Status 404 returned error can't find the container with id acb0bbee4e9af10a7c2fdebbebbc0fd23ac751270bd546b6d6fc67598b0ae357
Nov 02 20:21:19.455127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:19.455109    5457 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:21:20.454071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:20.454032    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" event={"ID":"a05af856-12ee-4e8d-b63a-6114058adb41","Type":"ContainerStarted","Data":"acb0bbee4e9af10a7c2fdebbebbc0fd23ac751270bd546b6d6fc67598b0ae357"}
Nov 02 20:21:23.806032 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:21:23.805985    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:21:24.470614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:24.470576    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" event={"ID":"a05af856-12ee-4e8d-b63a-6114058adb41","Type":"ContainerStarted","Data":"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"}
Nov 02 20:21:24.576745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:24.576696    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" podStartSLOduration=2.399836077 podStartE2EDuration="6.576668369s" totalImagesPullingTime="4.176832292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:21:24.575800953 +0000 UTC m=+351.514190020" watchObservedRunningTime="2026-11-02 20:21:24.576668369 +0000 UTC m=+351.515057437"
Nov 02 20:21:47.054981 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.054899    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:47.055517 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.055138    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" podUID="a05af856-12ee-4e8d-b63a-6114058adb41" containerName="authorino" containerID="cri-o://bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8" gracePeriod=30
Nov 02 20:21:47.280477 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.280452    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:47.302638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.302613    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\" (UniqueName: \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\") pod \"a05af856-12ee-4e8d-b63a-6114058adb41\" (UID: \"a05af856-12ee-4e8d-b63a-6114058adb41\") "
Nov 02 20:21:47.304720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.304663    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7" pod "a05af856-12ee-4e8d-b63a-6114058adb41" (UID: "a05af856-12ee-4e8d-b63a-6114058adb41"). InnerVolumeSpecName "kube-api-access-rp7j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:21:47.403382 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.403351    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp7j7\" (UniqueName: \"kubernetes.io/projected/a05af856-12ee-4e8d-b63a-6114058adb41-kube-api-access-rp7j7\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:21:47.564893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.564810    5457 generic.go:356] "Generic (PLEG): container finished" podID="a05af856-12ee-4e8d-b63a-6114058adb41" containerID="bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8" exitCode=0
Nov 02 20:21:47.564893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.564861    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-sdqkr"
Nov 02 20:21:47.565063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.564895    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" event={"ID":"a05af856-12ee-4e8d-b63a-6114058adb41","Type":"ContainerDied","Data":"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"}
Nov 02 20:21:47.565063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.564946    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-sdqkr" event={"ID":"a05af856-12ee-4e8d-b63a-6114058adb41","Type":"ContainerDied","Data":"acb0bbee4e9af10a7c2fdebbebbc0fd23ac751270bd546b6d6fc67598b0ae357"}
Nov 02 20:21:47.565063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.564962    5457 scope.go:122] "RemoveContainer" containerID="bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"
Nov 02 20:21:47.573080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.573062    5457 scope.go:122] "RemoveContainer" containerID="bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"
Nov 02 20:21:47.573372 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:21:47.573355    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8\": container with ID starting with bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8 not found: ID does not exist" containerID="bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"
Nov 02 20:21:47.573425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.573381    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8"} err="failed to get container status \"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8\": rpc error: code = NotFound desc = could not find container \"bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8\": container with ID starting with bb171783a2d84ddf345dc84c33243043cd3608f9ecb5ea424b3a658d36cd4fd8 not found: ID does not exist"
Nov 02 20:21:47.716120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.716092    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:47.719900 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:47.719877    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-sdqkr"]
Nov 02 20:21:49.171426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:21:49.171391    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a05af856-12ee-4e8d-b63a-6114058adb41" path="/var/lib/kubelet/pods/a05af856-12ee-4e8d-b63a-6114058adb41/volumes"
Nov 02 20:21:53.806459 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:21:53.806422    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:22:09.188194 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.188161    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:09.188572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.188464    5457 cpu_manager.go:414] "containerMap: removing container" podUID="a05af856-12ee-4e8d-b63a-6114058adb41" containerName="authorino"
Nov 02 20:22:09.188572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.188475    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a05af856-12ee-4e8d-b63a-6114058adb41" containerName="authorino"
Nov 02 20:22:09.188572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.188524    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="a05af856-12ee-4e8d-b63a-6114058adb41" containerName="authorino"
Nov 02 20:22:09.191452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.191433    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.240208 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.240174    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 02 20:22:09.240365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.240291    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 02 20:22:09.286273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.286241    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 02 20:22:09.286444 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.286429    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 02 20:22:09.286512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.286497    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 02 20:22:09.286552 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.286505    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r6lrl\""
Nov 02 20:22:09.286831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.286809    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.287071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.287047    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqp6\" (UniqueName: \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.287301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.287276    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.287811 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.287794    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:09.388734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.388698    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.388891 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.388756    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqp6\" (UniqueName: \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.388891 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.388812    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.391297 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.391275    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.391413 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.391392    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.446467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.446392    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqp6\" (UniqueName: \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\") pod \"maas-controller-579cf7c6d-dxmrn\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") " pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.506125 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.506091    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:09.599091 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.599058    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:22:09.601865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.601846    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.663231 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.663199    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:22:09.691371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.691339    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.691542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.691380    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.691542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.691487    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.792401 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.792308    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.792401 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.792374    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.792634 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.792416    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.794873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.794852    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.794958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.794889    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.849913 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.849880    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\") pod \"maas-controller-569554b5f8-tklx4\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") " pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:09.868920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.868888    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:09.872812 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:22:09.872784    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36f261d_dddc_46bd_85c8_b079c0cda21f.slice/crio-09b7f33f9d79581d87e974ae2d889d741744f804ca7f82bfbd833ff192972b8d WatchSource:0}: Error finding container 09b7f33f9d79581d87e974ae2d889d741744f804ca7f82bfbd833ff192972b8d: Status 404 returned error can't find the container with id 09b7f33f9d79581d87e974ae2d889d741744f804ca7f82bfbd833ff192972b8d
Nov 02 20:22:09.913595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:09.913565    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:10.275590 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:10.275553    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:22:10.279249 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:22:10.279218    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca4a320_854e_40fd_9ba9_7e3f97e691d1.slice/crio-05c79d566e81fe3cb44a14caa2c90374162456e8cb775f6ab88714542d688547 WatchSource:0}: Error finding container 05c79d566e81fe3cb44a14caa2c90374162456e8cb775f6ab88714542d688547: Status 404 returned error can't find the container with id 05c79d566e81fe3cb44a14caa2c90374162456e8cb775f6ab88714542d688547
Nov 02 20:22:10.656220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:10.656180    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerStarted","Data":"05c79d566e81fe3cb44a14caa2c90374162456e8cb775f6ab88714542d688547"}
Nov 02 20:22:10.657210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:10.657187    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" event={"ID":"f36f261d-dddc-46bd-85c8-b079c0cda21f","Type":"ContainerStarted","Data":"09b7f33f9d79581d87e974ae2d889d741744f804ca7f82bfbd833ff192972b8d"}
Nov 02 20:22:13.673048 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.673007    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" event={"ID":"f36f261d-dddc-46bd-85c8-b079c0cda21f","Type":"ContainerStarted","Data":"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"}
Nov 02 20:22:13.673520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.673140    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:13.674588 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.674560    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerStarted","Data":"77bd148bd983844e3f164fe8676c4346543335943231992ed48b4bd49931cc5c"}
Nov 02 20:22:13.674726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.674608    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:13.793124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.793076    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" podStartSLOduration=1.317022996 podStartE2EDuration="4.7930619s" totalImagesPullingTime="3.476038904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:22:13.791605532 +0000 UTC m=+400.729994600" watchObservedRunningTime="2026-11-02 20:22:13.7930619 +0000 UTC m=+400.731450977"
Nov 02 20:22:13.901566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:13.901506    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-569554b5f8-tklx4" podStartSLOduration=1.648760744 podStartE2EDuration="4.901491418s" totalImagesPullingTime="3.252730674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:22:13.900630531 +0000 UTC m=+400.839019592" watchObservedRunningTime="2026-11-02 20:22:13.901491418 +0000 UTC m=+400.839880499"
Nov 02 20:22:16.511090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.511052    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"]
Nov 02 20:22:16.514382 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.514360    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.562919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.562889    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 02 20:22:16.563045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.562930    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 02 20:22:16.609134 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.609098    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 02 20:22:16.609312 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.609293    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-s6p4b\""
Nov 02 20:22:16.610336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.610312    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"]
Nov 02 20:22:16.656730 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.656702    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9nx\" (UniqueName: \"kubernetes.io/projected/e415904d-5f7b-4e61-9513-c4c189ed7cd8-kube-api-access-jg9nx\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.656885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.656739    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e415904d-5f7b-4e61-9513-c4c189ed7cd8-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.656885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.656772    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.656885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.656873    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.757288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.757251    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.757454 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.757311    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9nx\" (UniqueName: \"kubernetes.io/projected/e415904d-5f7b-4e61-9513-c4c189ed7cd8-kube-api-access-jg9nx\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.757454 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.757419    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e415904d-5f7b-4e61-9513-c4c189ed7cd8-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.757565 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.757510    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.757618 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:16.757602    5457 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Nov 02 20:22:16.757720 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:16.757680    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source podName:e415904d-5f7b-4e61-9513-c4c189ed7cd8 nodeName:}" failed. No retries permitted until 2026-11-02 20:22:17.257659171 +0000 UTC m=+404.196048233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-k4dr5" (UID: "e415904d-5f7b-4e61-9513-c4c189ed7cd8") : configmap "usage-tenancy-proxy-source" not found
Nov 02 20:22:16.758007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.757988    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.760002 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.759977    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e415904d-5f7b-4e61-9513-c4c189ed7cd8-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:16.814758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:16.814662    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9nx\" (UniqueName: \"kubernetes.io/projected/e415904d-5f7b-4e61-9513-c4c189ed7cd8-kube-api-access-jg9nx\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:17.262499 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:17.262453    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:17.263331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:17.263311    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e415904d-5f7b-4e61-9513-c4c189ed7cd8-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-k4dr5\" (UID: \"e415904d-5f7b-4e61-9513-c4c189ed7cd8\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:17.426328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:17.426295    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:17.787016 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:17.786982    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"]
Nov 02 20:22:17.790922 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:22:17.790889    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode415904d_5f7b_4e61_9513_c4c189ed7cd8.slice/crio-d8a59d7f4a0c258ce4171ed4c2a01b6d5cbc13708cb10c57c9bcc45107501e67 WatchSource:0}: Error finding container d8a59d7f4a0c258ce4171ed4c2a01b6d5cbc13708cb10c57c9bcc45107501e67: Status 404 returned error can't find the container with id d8a59d7f4a0c258ce4171ed4c2a01b6d5cbc13708cb10c57c9bcc45107501e67
Nov 02 20:22:18.697324 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:18.697288    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5" event={"ID":"e415904d-5f7b-4e61-9513-c4c189ed7cd8","Type":"ContainerStarted","Data":"d8a59d7f4a0c258ce4171ed4c2a01b6d5cbc13708cb10c57c9bcc45107501e67"}
Nov 02 20:22:23.813856 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:23.813805    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:22:24.681521 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:24.681490    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:24.681948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:24.681921    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:22:24.933211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:24.933130    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:24.933731 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:24.933401    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" podUID="f36f261d-dddc-46bd-85c8-b079c0cda21f" containerName="manager" containerID="cri-o://93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819" gracePeriod=30
Nov 02 20:22:25.312366 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.312333    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:25.436828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.436800    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\" (UniqueName: \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\") pod \"f36f261d-dddc-46bd-85c8-b079c0cda21f\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") "
Nov 02 20:22:25.436994 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.436834    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\") pod \"f36f261d-dddc-46bd-85c8-b079c0cda21f\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") "
Nov 02 20:22:25.436994 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.436926    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\") pod \"f36f261d-dddc-46bd-85c8-b079c0cda21f\" (UID: \"f36f261d-dddc-46bd-85c8-b079c0cda21f\") "
Nov 02 20:22:25.439575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.439548    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6" pod "f36f261d-dddc-46bd-85c8-b079c0cda21f" (UID: "f36f261d-dddc-46bd-85c8-b079c0cda21f"). InnerVolumeSpecName "kube-api-access-jjqp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:22:25.439738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.439712    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert" pod "f36f261d-dddc-46bd-85c8-b079c0cda21f" (UID: "f36f261d-dddc-46bd-85c8-b079c0cda21f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:22:25.439793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.439754    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs" pod "f36f261d-dddc-46bd-85c8-b079c0cda21f" (UID: "f36f261d-dddc-46bd-85c8-b079c0cda21f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:22:25.537861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.537782    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:25.537861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.537819    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjqp6\" (UniqueName: \"kubernetes.io/projected/f36f261d-dddc-46bd-85c8-b079c0cda21f-kube-api-access-jjqp6\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:25.537861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.537833    5457 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f36f261d-dddc-46bd-85c8-b079c0cda21f-webhook-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:25.730624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.730578    5457 generic.go:356] "Generic (PLEG): container finished" podID="f36f261d-dddc-46bd-85c8-b079c0cda21f" containerID="93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819" exitCode=0
Nov 02 20:22:25.730847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.730635    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-dxmrn"
Nov 02 20:22:25.730847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.730667    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" event={"ID":"f36f261d-dddc-46bd-85c8-b079c0cda21f","Type":"ContainerDied","Data":"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"}
Nov 02 20:22:25.730847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.730753    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-dxmrn" event={"ID":"f36f261d-dddc-46bd-85c8-b079c0cda21f","Type":"ContainerDied","Data":"09b7f33f9d79581d87e974ae2d889d741744f804ca7f82bfbd833ff192972b8d"}
Nov 02 20:22:25.730847 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.730777    5457 scope.go:122] "RemoveContainer" containerID="93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"
Nov 02 20:22:25.745763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.745740    5457 scope.go:122] "RemoveContainer" containerID="93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"
Nov 02 20:22:25.746054 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:25.746025    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819\": container with ID starting with 93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819 not found: ID does not exist" containerID="93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"
Nov 02 20:22:25.746175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.746065    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819"} err="failed to get container status \"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819\": rpc error: code = NotFound desc = could not find container \"93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819\": container with ID starting with 93bbb83ce36591413381095e2d41efa98d83396465971d3843e7781967dd2819 not found: ID does not exist"
Nov 02 20:22:25.883494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.883392    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:25.929172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:25.929136    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-dxmrn"]
Nov 02 20:22:27.171234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:27.171199    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f36f261d-dddc-46bd-85c8-b079c0cda21f" path="/var/lib/kubelet/pods/f36f261d-dddc-46bd-85c8-b079c0cda21f/volumes"
Nov 02 20:22:32.765875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:32.765839    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5" event={"ID":"e415904d-5f7b-4e61-9513-c4c189ed7cd8","Type":"ContainerStarted","Data":"792b17e199baaa5f48b4377fa01dad1c49077bad2a9fc4b80194706349f777c7"}
Nov 02 20:22:32.766246 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:32.765958    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:32.875015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:32.874915    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5" podStartSLOduration=2.10886167 podStartE2EDuration="16.87490036s" totalImagesPullingTime="14.76603869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:22:32.874225616 +0000 UTC m=+419.812614686" watchObservedRunningTime="2026-11-02 20:22:32.87490036 +0000 UTC m=+419.813289474"
Nov 02 20:22:43.774638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:43.774599    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-k4dr5"
Nov 02 20:22:44.760666 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.760632    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"]
Nov 02 20:22:44.760981 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.760967    5457 cpu_manager.go:414] "containerMap: removing container" podUID="f36f261d-dddc-46bd-85c8-b079c0cda21f" containerName="manager"
Nov 02 20:22:44.761025 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.760981    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f36f261d-dddc-46bd-85c8-b079c0cda21f" containerName="manager"
Nov 02 20:22:44.761057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.761035    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="f36f261d-dddc-46bd-85c8-b079c0cda21f" containerName="manager"
Nov 02 20:22:44.763758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.763738    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.808934 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.808900    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.808944    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.808964    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvn2\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-kube-api-access-ngvn2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.809115    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.809134    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.809158    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.809306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.809195    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfc5314-9d45-45ce-838c-912987af9336-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.867940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.867906    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"]
Nov 02 20:22:44.910536 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910504    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910540    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910575    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910622    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfc5314-9d45-45ce-838c-912987af9336-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910712    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910749    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.910888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.910772    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvn2\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-kube-api-access-ngvn2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.911584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.911553    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.913018 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.912989    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfc5314-9d45-45ce-838c-912987af9336-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.913138 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.913036    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.913138 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.913098    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.913138 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.913111    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bfc5314-9d45-45ce-838c-912987af9336-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.968196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.968168    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:44.968361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:44.968344    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvn2\" (UniqueName: \"kubernetes.io/projected/0bfc5314-9d45-45ce-838c-912987af9336-kube-api-access-ngvn2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mt9tv\" (UID: \"0bfc5314-9d45-45ce-838c-912987af9336\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:45.075103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.075026    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:45.488525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.488487    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"]
Nov 02 20:22:45.491944 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:22:45.491913    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfc5314_9d45_45ce_838c_912987af9336.slice/crio-dd5150507b5a76b4f0e9f0a1c34b431c3e30c21d6330556f440162083a964468 WatchSource:0}: Error finding container dd5150507b5a76b4f0e9f0a1c34b431c3e30c21d6330556f440162083a964468: Status 404 returned error can't find the container with id dd5150507b5a76b4f0e9f0a1c34b431c3e30c21d6330556f440162083a964468
Nov 02 20:22:45.493906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.493875    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:22:45.493982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.493936    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:22:45.818859 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.818781    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv" event={"ID":"0bfc5314-9d45-45ce-838c-912987af9336","Type":"ContainerStarted","Data":"36cf609c8c900adbeaf1403a31fba78edd51d8559aeb15ae84b4dac16207ffc1"}
Nov 02 20:22:45.818859 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.818831    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv" event={"ID":"0bfc5314-9d45-45ce-838c-912987af9336","Type":"ContainerStarted","Data":"dd5150507b5a76b4f0e9f0a1c34b431c3e30c21d6330556f440162083a964468"}
Nov 02 20:22:45.819238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.818862    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:45.932347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:45.932297    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv" podStartSLOduration=1.932282493 podStartE2EDuration="1.932282493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:22:45.930902932 +0000 UTC m=+432.869292000" watchObservedRunningTime="2026-11-02 20:22:45.932282493 +0000 UTC m=+432.870671558"
Nov 02 20:22:46.825967 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:46.825925    5457 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mt9tv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:22:46.826415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:46.825984    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv" podUID="0bfc5314-9d45-45ce-838c-912987af9336" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:22:49.824904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:49.824874    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mt9tv"
Nov 02 20:22:49.991391 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:49.991361    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:22:49.991568 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:49.991548    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery" containerID="cri-o://10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257" gracePeriod=30
Nov 02 20:22:50.047298 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.047268    5457 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-7s9t7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.19:8080/ready\": dial tcp 10.134.0.19:8080: connect: connection refused" start-of-body=
Nov 02 20:22:50.047460 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.047331    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.19:8080/ready\": dial tcp 10.134.0.19:8080: connect: connection refused"
Nov 02 20:22:50.241528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.241504    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:22:50.356039 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356008    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356071    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356132    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356178    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356214    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356332    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356382    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\") pod \"1a8e716f-0b5e-452e-bda1-47308e173ee6\" (UID: \"1a8e716f-0b5e-452e-bda1-47308e173ee6\") "
Nov 02 20:22:50.356447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356397    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:22:50.356727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.356704    5457 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-ca-configmap\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.359110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359070    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:22:50.359110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359079    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "kube-api-access-8tkcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:22:50.359380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359357    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:22:50.359453 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359403    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:22:50.359927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359900    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:22:50.360037 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.359989    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token" pod "1a8e716f-0b5e-452e-bda1-47308e173ee6" (UID: "1a8e716f-0b5e-452e-bda1-47308e173ee6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:22:50.458235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458197    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-kube-api-access-8tkcc\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.458235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458237    5457 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-cacerts\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.458430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458252    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.458430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458267    5457 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-csr-dns-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.458430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458281    5457 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8e716f-0b5e-452e-bda1-47308e173ee6-istio-kubeconfig\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.458430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.458293    5457 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8e716f-0b5e-452e-bda1-47308e173ee6-local-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:22:50.693501 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.693445    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:22:50.693850 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.693835    5457 cpu_manager.go:414] "containerMap: removing container" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery"
Nov 02 20:22:50.693899 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.693851    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery"
Nov 02 20:22:50.693937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.693918    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerName="discovery"
Nov 02 20:22:50.697261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.697243    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.745709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.745664    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 02 20:22:50.745842 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.745721    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pchck\""
Nov 02 20:22:50.755081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.755057    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:22:50.761299 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.761278    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.761392 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.761317    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgx6\" (UniqueName: \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.840762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.840729    5457 generic.go:356] "Generic (PLEG): container finished" podID="1a8e716f-0b5e-452e-bda1-47308e173ee6" containerID="10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257" exitCode=0
Nov 02 20:22:50.841153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.840770    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"
Nov 02 20:22:50.841153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.840814    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" event={"ID":"1a8e716f-0b5e-452e-bda1-47308e173ee6","Type":"ContainerDied","Data":"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"}
Nov 02 20:22:50.841153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.840863    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7" event={"ID":"1a8e716f-0b5e-452e-bda1-47308e173ee6","Type":"ContainerDied","Data":"4ef1fb10ce5f17b9aecca949013c4fad3877680b81cc6f67b470e5c784543db0"}
Nov 02 20:22:50.841153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.840889    5457 scope.go:122] "RemoveContainer" containerID="10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"
Nov 02 20:22:50.849174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.849143    5457 scope.go:122] "RemoveContainer" containerID="10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"
Nov 02 20:22:50.849416 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:50.849399    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257\": container with ID starting with 10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257 not found: ID does not exist" containerID="10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"
Nov 02 20:22:50.849493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.849434    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257"} err="failed to get container status \"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257\": rpc error: code = NotFound desc = could not find container \"10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257\": container with ID starting with 10661c6d4607d0c4d1d6242d063d4c91c0412a7c0b2f2559823c3351cfbbe257 not found: ID does not exist"
Nov 02 20:22:50.862940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.862916    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.863063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.862959    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgx6\" (UniqueName: \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.865205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.865181    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.922932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.922901    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgx6\" (UniqueName: \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\") pod \"llmisvc-controller-manager-869d5dcc5d-x4rzs\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:50.997268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:50.997191    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:22:51.000920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:51.000899    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-7s9t7"]
Nov 02 20:22:51.008959 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:51.008934    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:51.171821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:51.171789    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a8e716f-0b5e-452e-bda1-47308e173ee6" path="/var/lib/kubelet/pods/1a8e716f-0b5e-452e-bda1-47308e173ee6/volumes"
Nov 02 20:22:51.371144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:51.371077    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:22:51.374320 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:22:51.374279    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4fe1d0d3_bddb_4c95_b2c9_e29bd63653e4.slice/crio-671b1e1e1f024d8018aa149da4947e5b69f75798101d60a1f2031b329f785ff5 WatchSource:0}: Error finding container 671b1e1e1f024d8018aa149da4947e5b69f75798101d60a1f2031b329f785ff5: Status 404 returned error can't find the container with id 671b1e1e1f024d8018aa149da4947e5b69f75798101d60a1f2031b329f785ff5
Nov 02 20:22:51.847270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:51.847237    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" event={"ID":"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4","Type":"ContainerStarted","Data":"671b1e1e1f024d8018aa149da4947e5b69f75798101d60a1f2031b329f785ff5"}
Nov 02 20:22:52.665043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:52.665008    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:22:53.807344 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:22:53.807314    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:22:54.861679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:54.861643    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" event={"ID":"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4","Type":"ContainerStarted","Data":"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"}
Nov 02 20:22:54.862104 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:54.861784    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:22:54.973805 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:22:54.973748    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" podStartSLOduration=2.548956408 podStartE2EDuration="4.973731575s" totalImagesPullingTime="2.424775167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:22:54.973220709 +0000 UTC m=+441.911609806" watchObservedRunningTime="2026-11-02 20:22:54.973731575 +0000 UTC m=+441.912120646"
Nov 02 20:23:08.092883 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.092846    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6659bff578-bmm65"]
Nov 02 20:23:08.131342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.131312    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.155587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.155561    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6659bff578-bmm65"]
Nov 02 20:23:08.200827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.200801    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 20:23:08.221209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.221182    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-openshift-service-ca\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.221326 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.221214    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-maas-api-tls\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.221326 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.221236    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-metrics-certs\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.221404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.221317    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zcv6\" (UniqueName: \"kubernetes.io/projected/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-kube-api-access-9zcv6\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.226193 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.226177    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 20:23:08.226296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.226197    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 20:23:08.226296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.226204    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 20:23:08.226296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.226265    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bg8z4\""
Nov 02 20:23:08.321866 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.321822    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-maas-api-tls\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.322027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.321873    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-metrics-certs\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.322027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.321905    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zcv6\" (UniqueName: \"kubernetes.io/projected/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-kube-api-access-9zcv6\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.322027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.322007    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-openshift-service-ca\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.322646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.322623    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-openshift-service-ca\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.324296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.324276    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-metrics-certs\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.324437 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.324417    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-maas-api-tls\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.378636 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.378574    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zcv6\" (UniqueName: \"kubernetes.io/projected/f3e828b2-65ec-4bf1-8683-d1b3cc8bd050-kube-api-access-9zcv6\") pod \"maas-api-6659bff578-bmm65\" (UID: \"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050\") " pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.441885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.441853    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:08.645263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.645231    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:23:08.648112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.648092    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.696655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.696635    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gvxgg\""
Nov 02 20:23:08.696797 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.696724    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 02 20:23:08.704740 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.704717    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:23:08.813332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.813300    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6659bff578-bmm65"]
Nov 02 20:23:08.816826 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:23:08.816794    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e828b2_65ec_4bf1_8683_d1b3cc8bd050.slice/crio-ac97c89f59726bc37cc87980180c260860f665fa14a9fb71444c0583c27e5ea3 WatchSource:0}: Error finding container ac97c89f59726bc37cc87980180c260860f665fa14a9fb71444c0583c27e5ea3: Status 404 returned error can't find the container with id ac97c89f59726bc37cc87980180c260860f665fa14a9fb71444c0583c27e5ea3
Nov 02 20:23:08.826368 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.826343    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s95ts\" (UniqueName: \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.826450 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.826379    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.921159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.921083    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65" event={"ID":"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050","Type":"ContainerStarted","Data":"ac97c89f59726bc37cc87980180c260860f665fa14a9fb71444c0583c27e5ea3"}
Nov 02 20:23:08.927543 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.927522    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s95ts\" (UniqueName: \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.927611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.927561    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.929990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.929973    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:08.984926 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:08.984902    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s95ts\" (UniqueName: \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\") pod \"authorino-69c9d89474-w9bgw\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") " pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:09.258912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:09.258830    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:23:09.620189 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:09.620111    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:23:09.624175 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:23:09.624142    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7b4cbf_e5eb_445d_a1b8_5f140297fd64.slice/crio-71389a47af2b64a9ff477d5168269dcce05c74c2865e91fe186fdc09a81071aa WatchSource:0}: Error finding container 71389a47af2b64a9ff477d5168269dcce05c74c2865e91fe186fdc09a81071aa: Status 404 returned error can't find the container with id 71389a47af2b64a9ff477d5168269dcce05c74c2865e91fe186fdc09a81071aa
Nov 02 20:23:09.928426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:09.928323    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c9d89474-w9bgw" event={"ID":"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64","Type":"ContainerStarted","Data":"71389a47af2b64a9ff477d5168269dcce05c74c2865e91fe186fdc09a81071aa"}
Nov 02 20:23:11.939817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:11.939778    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c9d89474-w9bgw" event={"ID":"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64","Type":"ContainerStarted","Data":"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"}
Nov 02 20:23:11.941369 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:11.941339    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65" event={"ID":"f3e828b2-65ec-4bf1-8683-d1b3cc8bd050","Type":"ContainerStarted","Data":"5a2590c052cd8b5ba93868e43c129e710769f5098da863e7da99eb0ced535a6b"}
Nov 02 20:23:11.941531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:11.941494    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:12.063228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:12.063178    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-69c9d89474-w9bgw" podStartSLOduration=2.813067307 podStartE2EDuration="4.063164418s" totalImagesPullingTime="1.250097111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:23:12.061992905 +0000 UTC m=+459.000381976" watchObservedRunningTime="2026-11-02 20:23:12.063164418 +0000 UTC m=+459.001553519"
Nov 02 20:23:12.173075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:12.173022    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65" podStartSLOduration=1.170193448 podStartE2EDuration="4.173007169s" totalImagesPullingTime="3.002813721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:23:12.172286851 +0000 UTC m=+459.110675930" watchObservedRunningTime="2026-11-02 20:23:12.173007169 +0000 UTC m=+459.111396236"
Nov 02 20:23:17.951024 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:17.950942    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6659bff578-bmm65"
Nov 02 20:23:23.806549 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:23:23.806505    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:23:25.868827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:23:25.868796    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:23:53.807498 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:23:53.807463    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:24:13.519199 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.519158    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"]
Nov 02 20:24:13.522635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.522612    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.569914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.569885    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c73a75e-3039-4476-92a4-2878dc11c539-cert\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.570030 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.569937    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsn95\" (UniqueName: \"kubernetes.io/projected/4c73a75e-3039-4476-92a4-2878dc11c539-kube-api-access-wsn95\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.581906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.581873    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"]
Nov 02 20:24:13.670681 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.670637    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c73a75e-3039-4476-92a4-2878dc11c539-cert\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.670852 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.670720    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsn95\" (UniqueName: \"kubernetes.io/projected/4c73a75e-3039-4476-92a4-2878dc11c539-kube-api-access-wsn95\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.672996 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.672973    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c73a75e-3039-4476-92a4-2878dc11c539-cert\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.727585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.727560    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsn95\" (UniqueName: \"kubernetes.io/projected/4c73a75e-3039-4476-92a4-2878dc11c539-kube-api-access-wsn95\") pod \"llmisvc-controller-manager-6466c554d8-6ws5j\" (UID: \"4c73a75e-3039-4476-92a4-2878dc11c539\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:13.835840 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:13.835767    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:14.196440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:14.196412    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"]
Nov 02 20:24:14.199552 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:24:14.199523    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c73a75e_3039_4476_92a4_2878dc11c539.slice/crio-bb5921896a54fd79d7e17e2eb24dcb354d4fa72acbea64e55264040d4556cf5c WatchSource:0}: Error finding container bb5921896a54fd79d7e17e2eb24dcb354d4fa72acbea64e55264040d4556cf5c: Status 404 returned error can't find the container with id bb5921896a54fd79d7e17e2eb24dcb354d4fa72acbea64e55264040d4556cf5c
Nov 02 20:24:15.201082 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:15.201051    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j" event={"ID":"4c73a75e-3039-4476-92a4-2878dc11c539","Type":"ContainerStarted","Data":"67726c0e80bd0a7d77afc243366635acc38ec8e55e718c28f44a44ee6ebfdcc3"}
Nov 02 20:24:15.201490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:15.201096    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j" event={"ID":"4c73a75e-3039-4476-92a4-2878dc11c539","Type":"ContainerStarted","Data":"bb5921896a54fd79d7e17e2eb24dcb354d4fa72acbea64e55264040d4556cf5c"}
Nov 02 20:24:15.201490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:15.201137    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:15.339049 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:15.338957    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j" podStartSLOduration=1.554810921 podStartE2EDuration="2.338941637s" totalImagesPullingTime="784.130716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:24:15.337677226 +0000 UTC m=+522.276066294" watchObservedRunningTime="2026-11-02 20:24:15.338941637 +0000 UTC m=+522.277330723"
Nov 02 20:24:23.806884 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:24:23.806789    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:24:43.311912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:43.311872    5457 generic.go:356] "Generic (PLEG): container finished" podID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerID="77bd148bd983844e3f164fe8676c4346543335943231992ed48b4bd49931cc5c" exitCode=1
Nov 02 20:24:43.312313 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:43.311924    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerDied","Data":"77bd148bd983844e3f164fe8676c4346543335943231992ed48b4bd49931cc5c"}
Nov 02 20:24:43.312313 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:43.312255    5457 scope.go:122] "RemoveContainer" containerID="77bd148bd983844e3f164fe8676c4346543335943231992ed48b4bd49931cc5c"
Nov 02 20:24:44.317366 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:44.317340    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerStarted","Data":"fa8276cf5861a684318907faab9c203a20afbcb09c4e117e1941a8caf1a48a77"}
Nov 02 20:24:44.317783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:44.317543    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:24:46.207672 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.207641    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6ws5j"
Nov 02 20:24:46.363150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.363121    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:24:46.363328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.363300    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" podUID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" containerName="manager" containerID="cri-o://aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5" gracePeriod=30
Nov 02 20:24:46.602416 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.602392    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:24:46.761080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.761009    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\" (UniqueName: \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\") pod \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") "
Nov 02 20:24:46.761220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.761098    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\" (UniqueName: \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\") pod \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\" (UID: \"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4\") "
Nov 02 20:24:46.763132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.763103    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert" pod "4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" (UID: "4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:24:46.763132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.763117    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6" pod "4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" (UID: "4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4"). InnerVolumeSpecName "kube-api-access-jzgx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:24:46.862519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.862483    5457 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:24:46.862519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:46.862515    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzgx6\" (UniqueName: \"kubernetes.io/projected/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4-kube-api-access-jzgx6\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:24:47.332603 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.332573    5457 generic.go:356] "Generic (PLEG): container finished" podID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" containerID="aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5" exitCode=0
Nov 02 20:24:47.333021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.332623    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"
Nov 02 20:24:47.333021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.332668    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" event={"ID":"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4","Type":"ContainerDied","Data":"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"}
Nov 02 20:24:47.333021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.332736    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs" event={"ID":"4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4","Type":"ContainerDied","Data":"671b1e1e1f024d8018aa149da4947e5b69f75798101d60a1f2031b329f785ff5"}
Nov 02 20:24:47.333021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.332758    5457 scope.go:122] "RemoveContainer" containerID="aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"
Nov 02 20:24:47.340730 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.340710    5457 scope.go:122] "RemoveContainer" containerID="aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"
Nov 02 20:24:47.340998 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:24:47.340979    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5\": container with ID starting with aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5 not found: ID does not exist" containerID="aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"
Nov 02 20:24:47.341050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.341008    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5"} err="failed to get container status \"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5\": rpc error: code = NotFound desc = could not find container \"aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5\": container with ID starting with aafb20f3c85c53f1bd8386b1b3c090db08ea356aff380b40b52127bc33d9a3e5 not found: ID does not exist"
Nov 02 20:24:47.484736 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.484637    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:24:47.530659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:47.530632    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-x4rzs"]
Nov 02 20:24:49.172704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:49.172612    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" path="/var/lib/kubelet/pods/4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4/volumes"
Nov 02 20:24:53.806876 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:24:53.806835    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:24:55.323650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:24:55.323620    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:25:08.364355 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:08.364319    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:25:17.967364 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:17.967322    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:25:23.807312 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:25:23.807268    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:25:33.229085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:33.229063    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:25:33.229811 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:33.229791    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:25:33.574663 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:33.574572    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:25:38.365808 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.365769    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:25:38.366216 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.366096    5457 cpu_manager.go:414] "containerMap: removing container" podUID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" containerName="manager"
Nov 02 20:25:38.366216 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.366107    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" containerName="manager"
Nov 02 20:25:38.366216 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.366177    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="4fe1d0d3-bddb-4c95-b2c9-e29bd63653e4" containerName="manager"
Nov 02 20:25:38.370797 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.370773    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.505893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.505852    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dg9qz\""
Nov 02 20:25:38.521288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521254    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521298    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521357    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521380    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvstw\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521636    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521734    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.521794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521773    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.522052 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521847    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.522052 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.521884    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.575848 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.575808    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:25:38.623338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623255    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623303    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvstw\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623342    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623381    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623414    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623453    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623498    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623525    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623554 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623550    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623769    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.623970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.623940    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.624177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.624153    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.624293 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.624181    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.624293 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.624236    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.625786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.625756    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.626149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.626126    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.680679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.680650    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.680969 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.680946    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvstw\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\") pod \"maas-default-gateway-openshift-default-85544d4cd7-9kwbn\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:38.685547 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:38.685526    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:39.101016 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:39.100978    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:25:39.104156 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:25:39.104125    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a73e54_98c9_47d1_9256_e2cb0e1cca38.slice/crio-a83ce00447e6a888c65fd127a2f1144d4393f0c595ca7f67e53337721de5ebd4 WatchSource:0}: Error finding container a83ce00447e6a888c65fd127a2f1144d4393f0c595ca7f67e53337721de5ebd4: Status 404 returned error can't find the container with id a83ce00447e6a888c65fd127a2f1144d4393f0c595ca7f67e53337721de5ebd4
Nov 02 20:25:39.556762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:39.556719    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" event={"ID":"92a73e54-98c9-47d1-9256-e2cb0e1cca38","Type":"ContainerStarted","Data":"a83ce00447e6a888c65fd127a2f1144d4393f0c595ca7f67e53337721de5ebd4"}
Nov 02 20:25:42.972042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:42.972010    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:25:42.972327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:42.972074    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:25:42.972327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:42.972109    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:25:43.202321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:43.202293    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:25:43.575005 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:43.574964    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" event={"ID":"92a73e54-98c9-47d1-9256-e2cb0e1cca38","Type":"ContainerStarted","Data":"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"}
Nov 02 20:25:43.686079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:43.686050    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:43.779120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:43.779074    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podStartSLOduration=1.91398454 podStartE2EDuration="5.779061466s" totalImagesPullingTime="3.865076926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:25:43.732847734 +0000 UTC m=+610.671236803" watchObservedRunningTime="2026-11-02 20:25:43.779061466 +0000 UTC m=+610.717450534"
Nov 02 20:25:44.687876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:44.687846    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:44.688258 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:44.687895    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:45.686614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:45.686573    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:45.686826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:45.686631    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:46.686982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:46.686945    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:46.687361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:46.687004    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:47.686190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:47.686152    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:47.686371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:47.686216    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:48.686350 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:48.686312    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:48.686790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:48.686364    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:49.686096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:49.686059    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-9kwbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Nov 02 20:25:49.686274 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:49.686122    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Nov 02 20:25:51.203810 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:51.203774    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:51.204531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:51.204231    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:51.205054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:25:51.205032    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:25:53.807961 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:25:53.807928    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:26:03.347935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.347889    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:26:03.348451 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.348125    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-69c9d89474-w9bgw" podUID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" containerName="authorino" containerID="cri-o://261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3" gracePeriod=30
Nov 02 20:26:03.592008 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.591984    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:26:03.669718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.669675    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\" (UniqueName: \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\") pod \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") "
Nov 02 20:26:03.669873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.669730    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\") pod \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\" (UID: \"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64\") "
Nov 02 20:26:03.671741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.671706    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts" pod "9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" (UID: "9f7b4cbf-e5eb-445d-a1b8-5f140297fd64"). InnerVolumeSpecName "kube-api-access-s95ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:26:03.679763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679733    5457 generic.go:356] "Generic (PLEG): container finished" podID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" containerID="261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3" exitCode=0
Nov 02 20:26:03.679859 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679778    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c9d89474-w9bgw"
Nov 02 20:26:03.679859 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679811    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c9d89474-w9bgw" event={"ID":"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64","Type":"ContainerDied","Data":"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"}
Nov 02 20:26:03.679943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679860    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c9d89474-w9bgw" event={"ID":"9f7b4cbf-e5eb-445d-a1b8-5f140297fd64","Type":"ContainerDied","Data":"71389a47af2b64a9ff477d5168269dcce05c74c2865e91fe186fdc09a81071aa"}
Nov 02 20:26:03.679943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679819    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert" pod "9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" (UID: "9f7b4cbf-e5eb-445d-a1b8-5f140297fd64"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:26:03.679943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.679883    5457 scope.go:122] "RemoveContainer" containerID="261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"
Nov 02 20:26:03.689293 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.689272    5457 scope.go:122] "RemoveContainer" containerID="261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"
Nov 02 20:26:03.689594 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:26:03.689577    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3\": container with ID starting with 261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3 not found: ID does not exist" containerID="261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"
Nov 02 20:26:03.689644 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.689605    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3"} err="failed to get container status \"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3\": rpc error: code = NotFound desc = could not find container \"261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3\": container with ID starting with 261e718184cc87c6d74b08e41a38a8589245e0af61b33aae8711134307b136d3 not found: ID does not exist"
Nov 02 20:26:03.770624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.770586    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s95ts\" (UniqueName: \"kubernetes.io/projected/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-kube-api-access-s95ts\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:26:03.770624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:03.770620    5457 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64-tls-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:26:04.094266 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:04.094235    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:26:04.097923 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:04.097899    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69c9d89474-w9bgw"]
Nov 02 20:26:05.172114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:26:05.172084    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" path="/var/lib/kubelet/pods/9f7b4cbf-e5eb-445d-a1b8-5f140297fd64/volumes"
Nov 02 20:26:23.807485 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:26:23.807398    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:26:53.806223 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:26:53.806185    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:27:23.563100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.563063    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:27:23.563478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.563429    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" containerName="authorino"
Nov 02 20:27:23.563478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.563440    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" containerName="authorino"
Nov 02 20:27:23.563544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.563494    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f7b4cbf-e5eb-445d-a1b8-5f140297fd64" containerName="authorino"
Nov 02 20:27:23.566292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.566274    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.662368 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.662332    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:27:23.684352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.684322    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.684513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.684373    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.684513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.684489    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.684610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.684542    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl9ms\" (UniqueName: \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.692645 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.692619    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-61cdc1-serving-cert\""
Nov 02 20:27:23.785380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.785350    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.785587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.785407    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.785587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.785439    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl9ms\" (UniqueName: \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.785587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.785493    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.785587 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:23.785585    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-serving-cert: secret "maas-api-e2e-worker-w3-61cdc1-serving-cert" not found
Nov 02 20:27:23.785851 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:23.785642    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls podName:5657212c-2388-4486-8a01-4e628b007a53 nodeName:}" failed. No retries permitted until 2026-11-02 20:27:24.285625533 +0000 UTC m=+711.224014595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls") pod "maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" (UID: "5657212c-2388-4486-8a01-4e628b007a53") : secret "maas-api-e2e-worker-w3-61cdc1-serving-cert" not found
Nov 02 20:27:23.786112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.786089    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.787880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.787856    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:23.807101 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:23.807073    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:27:23.843380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:23.843306    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl9ms\" (UniqueName: \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:24.290971 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:24.290933    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:24.293252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:24.293233    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") pod \"maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:24.478068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:24.478032    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:24.841706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:24.841655    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:27:24.845195 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:27:24.845165    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5657212c_2388_4486_8a01_4e628b007a53.slice/crio-2da015fa0decc6553b401e6bd7220192db00273e26142928d253078b15bc9e9e WatchSource:0}: Error finding container 2da015fa0decc6553b401e6bd7220192db00273e26142928d253078b15bc9e9e: Status 404 returned error can't find the container with id 2da015fa0decc6553b401e6bd7220192db00273e26142928d253078b15bc9e9e
Nov 02 20:27:24.846825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:24.846805    5457 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:27:25.020916 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:25.020879    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" event={"ID":"5657212c-2388-4486-8a01-4e628b007a53","Type":"ContainerStarted","Data":"2da015fa0decc6553b401e6bd7220192db00273e26142928d253078b15bc9e9e"}
Nov 02 20:27:25.096960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:25.096880    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:27:26.026967 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:26.026874    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" event={"ID":"5657212c-2388-4486-8a01-4e628b007a53","Type":"ContainerStarted","Data":"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"}
Nov 02 20:27:26.027374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:26.026975    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:26.137973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:26.137909    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" podStartSLOduration=2.348865191 podStartE2EDuration="3.137890631s" totalImagesPullingTime="789.02544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:27:26.136113808 +0000 UTC m=+713.074502876" watchObservedRunningTime="2026-11-02 20:27:26.137890631 +0000 UTC m=+713.076279700"
Nov 02 20:27:28.953643 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:28.953607    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:27:28.956998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:28.956979    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.005677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.005653    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-c49693-serving-cert\""
Nov 02 20:27:29.053306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.053265    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:27:29.129607 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.129578    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.129803 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.129629    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.129803 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.129754    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jqd\" (UniqueName: \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.129876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.129810    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.230533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.230443    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.230533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.230496    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jqd\" (UniqueName: \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.230778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.230540    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.230778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.230616    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.231270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.231242    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.232931 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.232903    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.233022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.232960    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.287837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.287810    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jqd\" (UniqueName: \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\") pod \"maas-api-e2e-worker-w5-c49693-85499595c6-gr46w\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.569129 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.569038    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:29.933119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:29.933086    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:27:29.936035 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:27:29.936011    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea85fa8_dabc_4852_a790_23aae5ceead6.slice/crio-1a0b6a6f58e86227897349c15c7b99cf9d61703250664e941a2098a47729bc35 WatchSource:0}: Error finding container 1a0b6a6f58e86227897349c15c7b99cf9d61703250664e941a2098a47729bc35: Status 404 returned error can't find the container with id 1a0b6a6f58e86227897349c15c7b99cf9d61703250664e941a2098a47729bc35
Nov 02 20:27:30.045975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:30.045935    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" event={"ID":"dea85fa8-dabc-4852-a790-23aae5ceead6","Type":"ContainerStarted","Data":"1a0b6a6f58e86227897349c15c7b99cf9d61703250664e941a2098a47729bc35"}
Nov 02 20:27:31.051838 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:31.051750    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" event={"ID":"dea85fa8-dabc-4852-a790-23aae5ceead6","Type":"ContainerStarted","Data":"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"}
Nov 02 20:27:31.052281 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:31.051880    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:31.162170 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:31.162109    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" podStartSLOduration=2.3370279050000002 podStartE2EDuration="3.162092553s" totalImagesPullingTime="825.064648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:27:31.161282768 +0000 UTC m=+718.099671836" watchObservedRunningTime="2026-11-02 20:27:31.162092553 +0000 UTC m=+718.100481618"
Nov 02 20:27:32.036561 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:32.036533    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:27:34.010400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:34.010369    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:27:37.061626 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:37.061590    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:27:39.250011 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.249978    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:27:39.253669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.253647    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.302189 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.302160    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-694cee-serving-cert\""
Nov 02 20:27:39.315300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.315277    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:27:39.325208 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.325184    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.325318 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.325213    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lhtf\" (UniqueName: \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.325381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.325354    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.325513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.325492    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.426933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.426899    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.427080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.426970    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.427080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.427028    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.427080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.427051    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lhtf\" (UniqueName: \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.427190 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:39.427108    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-serving-cert: secret "maas-api-e2e-worker-w2-694cee-serving-cert" not found
Nov 02 20:27:39.427190 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:39.427170    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls podName:7d673905-1dee-488d-acf3-b9376b4d3a13 nodeName:}" failed. No retries permitted until 2026-11-02 20:27:39.927155883 +0000 UTC m=+726.865544942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls") pod "maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" (UID: "7d673905-1dee-488d-acf3-b9376b4d3a13") : secret "maas-api-e2e-worker-w2-694cee-serving-cert" not found
Nov 02 20:27:39.427658 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.427635    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.429353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.429329    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.486594 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.486550    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lhtf\" (UniqueName: \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.931338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.931301    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:39.934163 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:39.934137    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") pod \"maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:40.166370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:40.166335    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:40.529195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:40.529099    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:27:40.533175 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:27:40.533143    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d673905_1dee_488d_acf3_b9376b4d3a13.slice/crio-b7017a74e5984cbff307eba90331737109f52736d09244c81ce31f8af78af4e2 WatchSource:0}: Error finding container b7017a74e5984cbff307eba90331737109f52736d09244c81ce31f8af78af4e2: Status 404 returned error can't find the container with id b7017a74e5984cbff307eba90331737109f52736d09244c81ce31f8af78af4e2
Nov 02 20:27:41.095893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:41.095858    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" event={"ID":"7d673905-1dee-488d-acf3-b9376b4d3a13","Type":"ContainerStarted","Data":"b7017a74e5984cbff307eba90331737109f52736d09244c81ce31f8af78af4e2"}
Nov 02 20:27:42.101207 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:42.101167    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" event={"ID":"7d673905-1dee-488d-acf3-b9376b4d3a13","Type":"ContainerStarted","Data":"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"}
Nov 02 20:27:42.101613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:42.101272    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:42.211484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:42.211427    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" podStartSLOduration=2.364909346 podStartE2EDuration="3.21141286s" totalImagesPullingTime="846.503514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:27:42.210246564 +0000 UTC m=+729.148635634" watchObservedRunningTime="2026-11-02 20:27:42.21141286 +0000 UTC m=+729.149801927"
Nov 02 20:27:44.719122 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:44.719047    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:27:48.111205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:48.111172    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:27:53.769560 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.769523    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:27:53.772973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.772952    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.808649 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:53.808615    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:27:53.821542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.821517    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-2250b4-serving-cert\""
Nov 02 20:27:53.857726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.851506    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.857726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.851555    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.857726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.851744    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.857726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.851824    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdfjk\" (UniqueName: \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.868975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.868942    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:27:53.953321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.953291    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.953531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.953328    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.953531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.953345    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.953531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.953367    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdfjk\" (UniqueName: \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.953531 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:53.953473    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-serving-cert: secret "maas-api-e2e-worker-w1-2250b4-serving-cert" not found
Nov 02 20:27:53.953768 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:27:53.953564    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls podName:c6b608b9-c599-47d8-8090-0e518d405c2f nodeName:}" failed. No retries permitted until 2026-11-02 20:27:54.453541261 +0000 UTC m=+741.391930329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls") pod "maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" (UID: "c6b608b9-c599-47d8-8090-0e518d405c2f") : secret "maas-api-e2e-worker-w1-2250b4-serving-cert" not found
Nov 02 20:27:53.954175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.954155    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:53.955720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:53.955701    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:54.011791 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:54.011732    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdfjk\" (UniqueName: \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:54.458486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:54.458443    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:54.460951 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:54.460919    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:54.687449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:54.687415    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:55.052612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:55.052536    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:27:55.057108 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:27:55.057075    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b608b9_c599_47d8_8090_0e518d405c2f.slice/crio-9a8d85face07cdd9d273dc66a71fe76892079cef11b65d51493b2db68253c022 WatchSource:0}: Error finding container 9a8d85face07cdd9d273dc66a71fe76892079cef11b65d51493b2db68253c022: Status 404 returned error can't find the container with id 9a8d85face07cdd9d273dc66a71fe76892079cef11b65d51493b2db68253c022
Nov 02 20:27:55.159312 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:55.159280    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" event={"ID":"c6b608b9-c599-47d8-8090-0e518d405c2f","Type":"ContainerStarted","Data":"9a8d85face07cdd9d273dc66a71fe76892079cef11b65d51493b2db68253c022"}
Nov 02 20:27:56.165880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:56.165793    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" event={"ID":"c6b608b9-c599-47d8-8090-0e518d405c2f","Type":"ContainerStarted","Data":"ff70951af44c164e58fa62d276c718b5d9e91c445a9c58004cab59fb6317fdb4"}
Nov 02 20:27:56.166313 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:56.165950    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:27:56.275307 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:27:56.275244    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" podStartSLOduration=2.43864617 podStartE2EDuration="3.275225662s" totalImagesPullingTime="836.579492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:27:56.274573864 +0000 UTC m=+743.212962933" watchObservedRunningTime="2026-11-02 20:27:56.275225662 +0000 UTC m=+743.213614732"
Nov 02 20:28:01.707885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.706751    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:28:01.711873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.711846    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.806675 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.806638    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a5cad4\"/\"kube-root-ca.crt\""
Nov 02 20:28:01.806879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.806796    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a5cad4\"/\"openshift-service-ca.crt\""
Nov 02 20:28:01.806879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.806868    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a5cad4\"/\"default-dockercfg-j46wd\""
Nov 02 20:28:01.806978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.806887    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a5cad4\"/\"simulator-w6-a5cad4-kserve-self-signed-certs\""
Nov 02 20:28:01.808260 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.808244    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:28:01.832531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832506    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.832674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832577    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.832674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832656    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.832783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832700    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bpwd\" (UniqueName: \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.832835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832817    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.832870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.832842    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933406    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933448    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933515    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933736 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933675    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933756    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933832 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933785    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bpwd\" (UniqueName: \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.933963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933939    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.934037 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.933964    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.934157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.934137    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.935767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.935742    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.936129 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.936108    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:01.990979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:01.990900    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bpwd\" (UniqueName: \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\") pod \"simulator-w6-a5cad4-kserve-86b794d487-xnrhv\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") " pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:02.023694 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:02.023659    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:02.178395 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:02.178370    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:28:02.290930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:02.290854    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:28:02.398651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:02.398617    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:28:03.202719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:03.202409    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" event={"ID":"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de","Type":"ContainerStarted","Data":"d6bc606801e23bb61a01a3e8992b3db9137159ab38360540f2041284d87549ff"}
Nov 02 20:28:04.208640 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:04.208553    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" event={"ID":"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de","Type":"ContainerStarted","Data":"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"}
Nov 02 20:28:04.317890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:04.317828    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podStartSLOduration=1.793304879 podStartE2EDuration="3.31781264s" totalImagesPullingTime="1.524507761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:28:04.316588012 +0000 UTC m=+751.254977098" watchObservedRunningTime="2026-11-02 20:28:04.31781264 +0000 UTC m=+751.256201739"
Nov 02 20:28:05.024242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:05.024211    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:11.521286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:11.521247    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:28:12.023994 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:12.023963    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:12.037518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:12.037491    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:12.254264 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:12.254233    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:28:23.808673 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:28:23.808638    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:28:29.605464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:29.605422    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:28:43.145788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.145748    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:28:43.150383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.150359    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.211774 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.211745    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.211941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.211794    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.211941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.211875    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.212049 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.212032    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.212101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.212075    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.212158 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.212129    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwjf\" (UniqueName: \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.245098 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.245056    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-c49693\"/\"openshift-service-ca.crt\""
Nov 02 20:28:43.245278 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.245121    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-c49693\"/\"simulator-w5-c49693-kserve-self-signed-certs\""
Nov 02 20:28:43.245278 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.245130    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-c49693\"/\"kube-root-ca.crt\""
Nov 02 20:28:43.245278 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.245208    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-c49693\"/\"default-dockercfg-ndc7b\""
Nov 02 20:28:43.246679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.246648    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:28:43.312811 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.312774    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.312821    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.312886    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.312918    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.312954    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwjf\" (UniqueName: \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.313021    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313434 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.313404    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.313403    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.313569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.313450    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.315268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.315244    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.315452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.315434    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.369730 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.369702    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwjf\" (UniqueName: \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\") pod \"simulator-w5-c49693-kserve-6c694b7b68-mwkhc\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") " pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.461982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.461890    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:43.842998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:43.842929    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:28:43.846589 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:28:43.846555    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod992dfb78_ad4b_465a_99ae_8f514b02ab1a.slice/crio-df891f7d176c7538cc6aa31d2870bcf3c36ff42f9a8d4ab9cbd186ea341de8d9 WatchSource:0}: Error finding container df891f7d176c7538cc6aa31d2870bcf3c36ff42f9a8d4ab9cbd186ea341de8d9: Status 404 returned error can't find the container with id df891f7d176c7538cc6aa31d2870bcf3c36ff42f9a8d4ab9cbd186ea341de8d9
Nov 02 20:28:44.384354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:44.384317    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" event={"ID":"992dfb78-ad4b-465a-99ae-8f514b02ab1a","Type":"ContainerStarted","Data":"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"}
Nov 02 20:28:44.384826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:44.384371    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" event={"ID":"992dfb78-ad4b-465a-99ae-8f514b02ab1a","Type":"ContainerStarted","Data":"df891f7d176c7538cc6aa31d2870bcf3c36ff42f9a8d4ab9cbd186ea341de8d9"}
Nov 02 20:28:44.462761 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:44.462718    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:44.495932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:44.495870    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podStartSLOduration=1.495854804 podStartE2EDuration="1.495854804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:28:44.495115294 +0000 UTC m=+791.433504362" watchObservedRunningTime="2026-11-02 20:28:44.495854804 +0000 UTC m=+791.434243872"
Nov 02 20:28:48.690227 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:48.690196    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:28:51.557863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.557827    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:28:51.561464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.561444    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.635953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.635922    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-30ee89\"/\"openshift-service-ca.crt\""
Nov 02 20:28:51.636096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.635953    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-30ee89\"/\"kube-root-ca.crt\""
Nov 02 20:28:51.656274 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.656238    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30ee89\"/\"default-dockercfg-7plks\""
Nov 02 20:28:51.656274 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.656238    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30ee89\"/\"simulator-w0-30ee89-kserve-self-signed-certs\""
Nov 02 20:28:51.657769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.657743    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:28:51.691679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691648    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.691854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691766    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzszl\" (UniqueName: \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.691854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691828    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.691854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691843    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.692017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691864    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.692017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.691942    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.792976    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793027    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793066    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793093    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793159    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793226    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzszl\" (UniqueName: \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793552    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793567    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.793875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.793809    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.795331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.795308    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.796073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.796054    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.850880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.850809    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzszl\" (UniqueName: \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\") pod \"simulator-w0-30ee89-kserve-84878bdfd5-z8llj\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") " pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:51.873522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:51.873489    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:52.241306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:52.241274    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:28:52.244750 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:28:52.244715    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72855b47_f229_4ec7_8bd8_c66ad4c68783.slice/crio-5c0fe1ce120c3bed3f45e3bfe88c197960b34294c8cf0c3616ef6943ea2eaaf5 WatchSource:0}: Error finding container 5c0fe1ce120c3bed3f45e3bfe88c197960b34294c8cf0c3616ef6943ea2eaaf5: Status 404 returned error can't find the container with id 5c0fe1ce120c3bed3f45e3bfe88c197960b34294c8cf0c3616ef6943ea2eaaf5
Nov 02 20:28:52.425804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:52.425769    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" event={"ID":"72855b47-f229-4ec7-8bd8-c66ad4c68783","Type":"ContainerStarted","Data":"2af94c6192c3e5555897f0eb352429987c20dc17e8bbd5c6c588d876b24edc81"}
Nov 02 20:28:52.425970 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:52.425815    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" event={"ID":"72855b47-f229-4ec7-8bd8-c66ad4c68783","Type":"ContainerStarted","Data":"5c0fe1ce120c3bed3f45e3bfe88c197960b34294c8cf0c3616ef6943ea2eaaf5"}
Nov 02 20:28:52.534531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:52.534413    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podStartSLOduration=1.534395488 podStartE2EDuration="1.534395488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:28:52.5337233 +0000 UTC m=+799.472112371" watchObservedRunningTime="2026-11-02 20:28:52.534395488 +0000 UTC m=+799.472784556"
Nov 02 20:28:52.874348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:52.874255    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:28:53.462895 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:53.462847    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:53.475413 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:53.475386    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:28:53.807900 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:28:53.807813    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:28:54.447033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:28:54.447007    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:29:01.874109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:01.874073    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:29:01.886353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:01.886328    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:29:02.487809 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:02.487777    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:29:14.443983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:14.443901    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:29:23.227173 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.227133    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:29:23.230844 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.230816    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.287267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.287235    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-2250b4\"/\"kube-root-ca.crt\""
Nov 02 20:29:23.290545 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290521    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.290664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290551    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.290664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290575    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.290815 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290761    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.290815 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290795    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.290875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.290817    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb5ls\" (UniqueName: \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.325680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.325652    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-2250b4\"/\"openshift-service-ca.crt\""
Nov 02 20:29:23.325680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.325661    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-2250b4\"/\"default-dockercfg-swxfm\""
Nov 02 20:29:23.325882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.325767    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-2250b4\"/\"simulator-w1-2250b4-kserve-self-signed-certs\""
Nov 02 20:29:23.327321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.327304    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:29:23.392018 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.391983    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb5ls\" (UniqueName: \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392052    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392070    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392093    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392137    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392163    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392523    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392577    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.392637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.392610    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.394504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.394476    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.394796 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.394778    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.449249 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.449211    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb5ls\" (UniqueName: \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\") pod \"simulator-w1-2250b4-kserve-7f6c84bc45-qppds\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") " pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.542165 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.542078    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:23.808227 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:29:23.808094    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:29:23.914831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:23.914806    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:29:23.917477 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:29:23.917449    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb1112e4_6778_4b20_8b2c_e4d072542275.slice/crio-7d58dca1366a904e92f46c67ebe7d7f96807aad09a7ef95fcec6f9b6428f6e91 WatchSource:0}: Error finding container 7d58dca1366a904e92f46c67ebe7d7f96807aad09a7ef95fcec6f9b6428f6e91: Status 404 returned error can't find the container with id 7d58dca1366a904e92f46c67ebe7d7f96807aad09a7ef95fcec6f9b6428f6e91
Nov 02 20:29:24.576856 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:24.576816    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" event={"ID":"bb1112e4-6778-4b20-8b2c-e4d072542275","Type":"ContainerStarted","Data":"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"}
Nov 02 20:29:24.577263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:24.576866    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" event={"ID":"bb1112e4-6778-4b20-8b2c-e4d072542275","Type":"ContainerStarted","Data":"7d58dca1366a904e92f46c67ebe7d7f96807aad09a7ef95fcec6f9b6428f6e91"}
Nov 02 20:29:24.685829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:24.685774    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podStartSLOduration=1.685758017 podStartE2EDuration="1.685758017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:29:24.684954054 +0000 UTC m=+831.623343121" watchObservedRunningTime="2026-11-02 20:29:24.685758017 +0000 UTC m=+831.624147088"
Nov 02 20:29:25.543078 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:25.543044    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:30.730193 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:30.730155    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:29:33.542937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:33.542898    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:33.555434 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:33.555398    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:33.625853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:33.625824    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:29:50.321461 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:29:50.321419    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:29:53.808389 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:29:53.808345    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:30:16.884580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:16.884541    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:30:23.807380 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:30:23.807342    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:30:31.304418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.304384    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:30:31.307731 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.307712    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.402478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.402442    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-694cee\"/\"kube-root-ca.crt\""
Nov 02 20:30:31.402478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.402452    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-694cee\"/\"openshift-service-ca.crt\""
Nov 02 20:30:31.402710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.402519    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-694cee\"/\"default-dockercfg-sdqsf\""
Nov 02 20:30:31.402710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.402596    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-694cee\"/\"premium-w2-694cee-kserve-self-signed-certs\""
Nov 02 20:30:31.404023 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.404005    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:30:31.442955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.442919    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.443238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.443209    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.443474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.443451    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.443671 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.443645    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.443826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.443728    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkr5l\" (UniqueName: \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.443826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.443766    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545255 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545209    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545262    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545308    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkr5l\" (UniqueName: \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545335    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545377    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545407    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545740 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545712    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545804    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.545879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.545861    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.547729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.547703    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.547995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.547979    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.602430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.602344    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkr5l\" (UniqueName: \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\") pod \"premium-w2-694cee-kserve-68b8878c58-p8rn4\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") " pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:31.620733 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:31.620703    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:32.005578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:32.005549    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:30:32.009020 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:30:32.008591    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9e7d7b6_93d8_4b61_a887_9fca549a7eda.slice/crio-fb27b74ec7caf0fa47973ce0fe715aa83b5f8b110d1adf5b2ac2bd6ca199b77f WatchSource:0}: Error finding container fb27b74ec7caf0fa47973ce0fe715aa83b5f8b110d1adf5b2ac2bd6ca199b77f: Status 404 returned error can't find the container with id fb27b74ec7caf0fa47973ce0fe715aa83b5f8b110d1adf5b2ac2bd6ca199b77f
Nov 02 20:30:32.881220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:32.881183    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" event={"ID":"e9e7d7b6-93d8-4b61-a887-9fca549a7eda","Type":"ContainerStarted","Data":"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"}
Nov 02 20:30:32.881220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:32.881225    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" event={"ID":"e9e7d7b6-93d8-4b61-a887-9fca549a7eda","Type":"ContainerStarted","Data":"fb27b74ec7caf0fa47973ce0fe715aa83b5f8b110d1adf5b2ac2bd6ca199b77f"}
Nov 02 20:30:32.990381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:32.990331    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podStartSLOduration=1.990318308 podStartE2EDuration="1.990318308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:30:32.989922557 +0000 UTC m=+899.928311640" watchObservedRunningTime="2026-11-02 20:30:32.990318308 +0000 UTC m=+899.928707377"
Nov 02 20:30:33.260616 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:33.260589    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:30:33.261741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:33.261715    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:30:33.621424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:33.621357    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:41.620793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:41.620759    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:41.633819 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:41.633789    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:41.933148 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:41.933113    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:30:42.512304 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.512269    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:30:42.516037 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.516013    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.564815 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.564788    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-2250b4\"/\"premium-w1-2250b4-kserve-self-signed-certs\""
Nov 02 20:30:42.612374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.612340    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650231    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650314    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc9g9\" (UniqueName: \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650434    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650495    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650551    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.652247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.650592    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752208 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752169    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752240    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc9g9\" (UniqueName: \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752323    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752354    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752394    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752440    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752739 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752665    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752797 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752762    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.752891 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.752870    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.755037 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.755011    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.755388 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.755364    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.810367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.810297    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc9g9\" (UniqueName: \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\") pod \"premium-w1-2250b4-kserve-68cdd5b988-vg52w\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") " pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:42.827005 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:42.826977    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:43.217966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:43.217942    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:30:43.220805 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:30:43.220777    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e156bc4_0902_4f18_ad4a_3443cd3126b2.slice/crio-09b6da21a5308cb1acc7f709fca81cbe3b142b53fd0259436dfaf63c6cd870cc WatchSource:0}: Error finding container 09b6da21a5308cb1acc7f709fca81cbe3b142b53fd0259436dfaf63c6cd870cc: Status 404 returned error can't find the container with id 09b6da21a5308cb1acc7f709fca81cbe3b142b53fd0259436dfaf63c6cd870cc
Nov 02 20:30:43.325817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:43.325782    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:30:43.942575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:43.942535    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" event={"ID":"8e156bc4-0902-4f18-ad4a-3443cd3126b2","Type":"ContainerStarted","Data":"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"}
Nov 02 20:30:43.943344 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:43.943307    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" event={"ID":"8e156bc4-0902-4f18-ad4a-3443cd3126b2","Type":"ContainerStarted","Data":"09b6da21a5308cb1acc7f709fca81cbe3b142b53fd0259436dfaf63c6cd870cc"}
Nov 02 20:30:44.053321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:44.053265    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podStartSLOduration=2.053250954 podStartE2EDuration="2.053250954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:30:44.052427482 +0000 UTC m=+910.990816550" watchObservedRunningTime="2026-11-02 20:30:44.053250954 +0000 UTC m=+910.991640021"
Nov 02 20:30:44.827213 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:44.827176    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:52.827857 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:52.827820    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:52.840189 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:52.840160    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:53.001180 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:30:53.001154    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:30:53.808384 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:30:53.808350    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:31:10.356152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:31:10.356113    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:31:23.807827 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:31:23.807769    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:31:51.161262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:31:51.161224    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:31:53.810275 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:31:53.810229    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:32:08.379741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.379706    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:32:08.384531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.384509    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414198 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414173    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414218    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414239    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414332    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414355    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414388    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414465    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmj9\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414500    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.414530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.414522    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515095 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515058    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515269 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515115    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515269 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515150    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515269 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515197    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515269 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515242    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515287    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515321    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515374    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515425    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmj9\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515599    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515885    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.515906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.515906    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.516172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.516138    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.516390 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.516367    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.517948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.517923    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.518061 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.517928    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.576218 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.576183    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.576415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.576388    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmj9\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\") pod \"maas-default-gateway-openshift-default-85544d4cd7-sd8dr\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:08.585050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.585022    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:32:08.697042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:08.697013    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:09.112831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.112754    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:32:09.116359 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:32:09.116322    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc248393_4901_4bef_a08b_3ae4a19e6762.slice/crio-70e45f0b8170b7f88f6a061d9089a204523452200f27f86ba94e4304fceec4f7 WatchSource:0}: Error finding container 70e45f0b8170b7f88f6a061d9089a204523452200f27f86ba94e4304fceec4f7: Status 404 returned error can't find the container with id 70e45f0b8170b7f88f6a061d9089a204523452200f27f86ba94e4304fceec4f7
Nov 02 20:32:09.118610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.118577    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:09.118707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.118643    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:09.118707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.118669    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:09.370585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.370500    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" event={"ID":"cc248393-4901-4bef-a08b-3ae4a19e6762","Type":"ContainerStarted","Data":"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"}
Nov 02 20:32:09.370585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.370553    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" event={"ID":"cc248393-4901-4bef-a08b-3ae4a19e6762","Type":"ContainerStarted","Data":"70e45f0b8170b7f88f6a061d9089a204523452200f27f86ba94e4304fceec4f7"}
Nov 02 20:32:09.483382 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.483319    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podStartSLOduration=1.483305484 podStartE2EDuration="1.483305484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:32:09.482481028 +0000 UTC m=+996.420870097" watchObservedRunningTime="2026-11-02 20:32:09.483305484 +0000 UTC m=+996.421694546"
Nov 02 20:32:09.701709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:09.700800    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:10.713707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:10.712804    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:10.713707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:10.712868    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:11.701215 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:11.701178    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:11.701508 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:11.701469    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:12.700958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:12.700924    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:12.701538 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:12.701487    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:13.713923 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:13.713827    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:13.713923 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:13.713902    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:14.701709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:14.699330    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:14.701709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:14.699390    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:15.697885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:15.697846    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Nov 02 20:32:15.698285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:15.697901    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Nov 02 20:32:17.698657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:17.698616    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:32:17.699089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:17.698732    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:32:18.740875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:18.740827    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-sd8dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:32:18.741376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:18.740910    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:32:19.335961 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:19.335930    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:19.336250 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:19.336219    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:19.337078 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:19.337056    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:32:23.159666 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.159628    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:32:23.391355 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.391324    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:32:23.394938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.394917    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472369 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472270    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472379    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472424    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nwm\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472462    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472522    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472558    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472596    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472622    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.472793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.472663    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.489563 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.489499    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:32:23.573680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573639    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49nwm\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.573886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573701    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.573886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573752    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.573886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573785    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.573886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573841    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.573886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573881    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573919    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.573980    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574067    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574231    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574311    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574350    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574543    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.574628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.574592    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.576791 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.576766    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.576914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.576814    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.633578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.633495    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.638221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.638176    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nwm\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\") pod \"maas-default-gateway-openshift-default-85544d4cd7-gjf7v\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.710359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:23.710328    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:23.829285 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:32:23.829194    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:32:24.136079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.136015    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:32:24.138772 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:32:24.138744    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb7dcf6_4bf3_4e1b_8679_dc8e527de37e.slice/crio-e76d953ae50987f3213128ed06f0d9aa8b4088ff9bc75d8496dc3a97ac31a48d WatchSource:0}: Error finding container e76d953ae50987f3213128ed06f0d9aa8b4088ff9bc75d8496dc3a97ac31a48d: Status 404 returned error can't find the container with id e76d953ae50987f3213128ed06f0d9aa8b4088ff9bc75d8496dc3a97ac31a48d
Nov 02 20:32:24.140872 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.140845    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:24.140942 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.140904    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:24.140942 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.140933    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:24.491117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.490908    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" event={"ID":"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e","Type":"ContainerStarted","Data":"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"}
Nov 02 20:32:24.491117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.490970    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" event={"ID":"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e","Type":"ContainerStarted","Data":"e76d953ae50987f3213128ed06f0d9aa8b4088ff9bc75d8496dc3a97ac31a48d"}
Nov 02 20:32:24.604001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.603919    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podStartSLOduration=1.60390403 podStartE2EDuration="1.60390403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:32:24.602873513 +0000 UTC m=+1011.541262592" watchObservedRunningTime="2026-11-02 20:32:24.60390403 +0000 UTC m=+1011.542293097"
Nov 02 20:32:24.715711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:24.714810    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:25.713202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:25.713164    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:25.713827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:25.713783    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:26.713711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:26.713102    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:26.713711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:26.713179    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:27.713101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:27.713064    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:27.713590 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:27.713557    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:28.714107 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:28.714069    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:28.714592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:28.714154    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:29.717184 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:29.717144    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:29.717625 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:29.717230    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:30.711217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:30.711177    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-gjf7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Nov 02 20:32:30.711418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:30.711244    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Nov 02 20:32:32.387795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:32.387762    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:32.388257 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:32.388145    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:32.388904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:32.388884    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:32:34.962712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:34.962644    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:32:34.966750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:34.966726    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.015606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.015582    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-bce768-openshift-default-dockercfg-xdqwh\""
Nov 02 20:32:35.068552 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.068513    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:32:35.116721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116680    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.116884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116739    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.116884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116810    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.116884 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116873    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x29ml\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.116983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116946    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.116983 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.116975    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.117045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.117018    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.117118 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.117102    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.117155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.117141    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.217947 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.217866    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.217947 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.217908    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.217947 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.217946    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x29ml\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.217971    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.217989    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218024    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218223    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218295    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218357    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218361    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218449    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218539    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218681 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218621    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.218986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.218964    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.220447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.220425    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.220822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.220800    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.275000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.274967    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.275112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.275089    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x29ml\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.278818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.278799    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:35.703268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.703245    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:32:35.706100 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:32:35.706070    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8754a7e5_161b_4b08_a5c3_0cf6124c003a.slice/crio-18960650060b6c4f879a8d3e9ef51d0a6f832ebefaa107ce5dfc82fbb9c0d09e WatchSource:0}: Error finding container 18960650060b6c4f879a8d3e9ef51d0a6f832ebefaa107ce5dfc82fbb9c0d09e: Status 404 returned error can't find the container with id 18960650060b6c4f879a8d3e9ef51d0a6f832ebefaa107ce5dfc82fbb9c0d09e
Nov 02 20:32:35.708352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.708318    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:35.708444 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.708383    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:35.708444 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:35.708413    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:36.571349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:36.571311    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" event={"ID":"8754a7e5-161b-4b08-a5c3-0cf6124c003a","Type":"ContainerStarted","Data":"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"}
Nov 02 20:32:36.571944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:36.571363    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" event={"ID":"8754a7e5-161b-4b08-a5c3-0cf6124c003a","Type":"ContainerStarted","Data":"18960650060b6c4f879a8d3e9ef51d0a6f832ebefaa107ce5dfc82fbb9c0d09e"}
Nov 02 20:32:36.775887 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:36.775833    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podStartSLOduration=2.775820134 podStartE2EDuration="2.775820134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:32:36.729773005 +0000 UTC m=+1023.668162075" watchObservedRunningTime="2026-11-02 20:32:36.775820134 +0000 UTC m=+1023.714209201"
Nov 02 20:32:37.279202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:37.279170    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:37.280708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:37.280668    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 20:32:37.280763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:37.280733    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 20:32:38.279458 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:38.279422    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 20:32:38.279853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:38.279478    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 20:32:39.279680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:39.279647    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 20:32:39.280095 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:39.279717    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 20:32:40.279750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:40.279716    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 20:32:40.280227 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:40.279774    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 20:32:41.279522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:41.279485    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 20:32:41.279721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:41.279541    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 20:32:42.529435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:42.529402    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:42.529981 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:42.529866    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:42.530738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:42.530718    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:32:49.742262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.742226    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:32:49.745894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.745869    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.797066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.797046    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-a5cad4-openshift-default-dockercfg-phnwd\""
Nov 02 20:32:49.804533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804507    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804537    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804554    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9xg\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804630    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804734    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804771    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804793    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804859    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.804962 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.804948    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.844986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.844957    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:32:49.905759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.905728    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.905759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.905763    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.905992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.905782    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9xg\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.905992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.905822    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.905992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.905867    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906013    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906058    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906095    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906142    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906360 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906243    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906360 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906276    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906445 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906394    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906445 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906433    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.906869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.906851    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.908106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.908091    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.908598 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.908581    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.962908 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.962875    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:49.963044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:49.963020    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9xg\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:50.059971 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.059879    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:50.479036 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.479007    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:32:50.515074 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:32:50.515039    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff61a5b0_370d_4b14_8284_be92dda977dc.slice/crio-d66062c55597788016b14c093778aee43bde444253215edecaf59d8063bb077f WatchSource:0}: Error finding container d66062c55597788016b14c093778aee43bde444253215edecaf59d8063bb077f: Status 404 returned error can't find the container with id d66062c55597788016b14c093778aee43bde444253215edecaf59d8063bb077f
Nov 02 20:32:50.517348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.517317    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:50.517432 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.517384    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:50.517432 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.517411    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:32:50.651004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.650962    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" event={"ID":"ff61a5b0-370d-4b14-8284-be92dda977dc","Type":"ContainerStarted","Data":"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"}
Nov 02 20:32:50.651189 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.651031    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" event={"ID":"ff61a5b0-370d-4b14-8284-be92dda977dc","Type":"ContainerStarted","Data":"d66062c55597788016b14c093778aee43bde444253215edecaf59d8063bb077f"}
Nov 02 20:32:50.763142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:50.763018    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podStartSLOduration=1.762998868 podStartE2EDuration="1.762998868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:32:50.76226345 +0000 UTC m=+1037.700652537" watchObservedRunningTime="2026-11-02 20:32:50.762998868 +0000 UTC m=+1037.701387960"
Nov 02 20:32:51.060579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:51.060469    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:51.062192 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:51.062165    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:51.062329 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:51.062211    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:52.060411 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:52.060373    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:52.060834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:52.060439    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:53.060960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:53.060922    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:53.061416 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:53.060985    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:53.837803 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:32:53.837765    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:32:54.061198 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:54.061165    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:54.061584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:54.061229    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:55.060439 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:55.060406    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:55.060623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:55.060458    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:56.060505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:56.060470    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Nov 02 20:32:56.060928 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:56.060545    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Nov 02 20:32:57.113199 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:57.113164    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:57.113988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:57.113962    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:32:57.114858 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:32:57.114836    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:33:01.144530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:01.144496    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:33:03.879741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.879708    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:33:03.884304 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.884283    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963222    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963408 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963376    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963509 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963487    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963556 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963521    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963556 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963549    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.963735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.963678    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq4fl\" (UniqueName: \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:03.979857 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.979833    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a5cad4\"/\"distinct-w6-a5cad4-kserve-self-signed-certs\""
Nov 02 20:33:03.981637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:03.981617    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071599    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071719    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071751    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071789    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071824    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq4fl\" (UniqueName: \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.071850    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.072423    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.073327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.072940    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.074462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.074431    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.079337 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.079315    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.080066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.080040    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.132249 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.132221    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq4fl\" (UniqueName: \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\") pod \"distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") " pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.195797 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.195761    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:04.628876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.628660    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:33:04.631648 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:33:04.631613    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10eb3e7e_e4f6_4721_83ae_3f04218ec60d.slice/crio-98fd7c872f6de14f7408144888b1f0d16337557fd95e0ef4508d201ee090c46b WatchSource:0}: Error finding container 98fd7c872f6de14f7408144888b1f0d16337557fd95e0ef4508d201ee090c46b: Status 404 returned error can't find the container with id 98fd7c872f6de14f7408144888b1f0d16337557fd95e0ef4508d201ee090c46b
Nov 02 20:33:04.721904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.721856    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" event={"ID":"10eb3e7e-e4f6-4721-83ae-3f04218ec60d","Type":"ContainerStarted","Data":"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"}
Nov 02 20:33:04.722068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.721913    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" event={"ID":"10eb3e7e-e4f6-4721-83ae-3f04218ec60d","Type":"ContainerStarted","Data":"98fd7c872f6de14f7408144888b1f0d16337557fd95e0ef4508d201ee090c46b"}
Nov 02 20:33:04.832166 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:04.832114    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podStartSLOduration=1.832098479 podStartE2EDuration="1.832098479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:33:04.831218418 +0000 UTC m=+1051.769607484" watchObservedRunningTime="2026-11-02 20:33:04.832098479 +0000 UTC m=+1051.770487561"
Nov 02 20:33:05.196486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:05.196454    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:11.109085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.109044    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:33:11.113086 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.113062    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.207724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.207676    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30ee89\"/\"distinct-w0-30ee89-kserve-self-signed-certs\""
Nov 02 20:33:11.209566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.209525    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:33:11.255625 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.255588    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.257340 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.257305    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.257489 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.257394    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82hl7\" (UniqueName: \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.257587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.257518    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.257668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.257620    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.257668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.257657    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.358990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.358954    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82hl7\" (UniqueName: \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359225 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359122    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359225 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359209    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359364 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359235    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359364 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359301    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359364 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359357    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359603 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359582    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359791 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359671    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.359914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.359847    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.362164 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.362138    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.362384 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.362362    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.416059 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.416023    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82hl7\" (UniqueName: \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\") pod \"distinct-w0-30ee89-kserve-6d4f765475-lblc9\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") " pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.425207 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.424775    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:11.863281 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:11.863247    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:33:11.866502 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:33:11.866477    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23168022_acbf_40b3_b607_53d13f9e1a5f.slice/crio-9f8efa9955a4e7ab3016723316e14270f3bf66c8a9a7af1500b8a8fda238d598 WatchSource:0}: Error finding container 9f8efa9955a4e7ab3016723316e14270f3bf66c8a9a7af1500b8a8fda238d598: Status 404 returned error can't find the container with id 9f8efa9955a4e7ab3016723316e14270f3bf66c8a9a7af1500b8a8fda238d598
Nov 02 20:33:12.763547 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:12.763516    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" event={"ID":"23168022-acbf-40b3-b607-53d13f9e1a5f","Type":"ContainerStarted","Data":"6a3bc29f8d4b2c7d84f19d448c3d50d4dffda46a5986b408959b899a0a02a278"}
Nov 02 20:33:12.763547 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:12.763556    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" event={"ID":"23168022-acbf-40b3-b607-53d13f9e1a5f","Type":"ContainerStarted","Data":"9f8efa9955a4e7ab3016723316e14270f3bf66c8a9a7af1500b8a8fda238d598"}
Nov 02 20:33:12.871854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:12.871801    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podStartSLOduration=1.871786335 podStartE2EDuration="1.871786335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:33:12.871213774 +0000 UTC m=+1059.809602841" watchObservedRunningTime="2026-11-02 20:33:12.871786335 +0000 UTC m=+1059.810175402"
Nov 02 20:33:13.430834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:13.428794    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:14.196480 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:14.196435    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:14.210127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:14.210096    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:14.784799 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:14.784768    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:33:21.425993 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:21.425957    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:21.438792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:21.438763    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:21.819488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:21.819408    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:33:23.808209 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:33:23.808177    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:33:33.086530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:33.086489    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:33:36.273991 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.273949    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:33:36.278727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.278707    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.327426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.327392    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-c49693-openshift-default-dockercfg-cq675\""
Nov 02 20:33:36.363893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.363859    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstr9\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.363926    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364006    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364099 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364034    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364169 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364146    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364215 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364186    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364311 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364294    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364368 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364336    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.364464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.364451    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.382846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.382820    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:33:36.465401 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465367    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465463    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465512    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tstr9\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465587    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465735    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465775    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465856    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465881    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.465938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465903    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.466075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465952    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.466075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.465988    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.466197 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.466165    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.466261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.466237    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.466261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.466249    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.468119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.468091    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.468228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.468161    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.522605 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.522574    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.522750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.522657    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstr9\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:36.591440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:36.591354    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:37.032036 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.032009    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:33:37.034245 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:33:37.034216    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b61ffb6_77e1_4618_a948_4c8d19fdc95a.slice/crio-d5090f39cd941e3abd904b29f15047f870031aef2ed250dd923282d0639ea9bd WatchSource:0}: Error finding container d5090f39cd941e3abd904b29f15047f870031aef2ed250dd923282d0639ea9bd: Status 404 returned error can't find the container with id d5090f39cd941e3abd904b29f15047f870031aef2ed250dd923282d0639ea9bd
Nov 02 20:33:37.037819 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.037784    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:33:37.037905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.037888    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:33:37.037953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.037936    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:33:37.907390 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.907353    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" event={"ID":"0b61ffb6-77e1-4618-a948-4c8d19fdc95a","Type":"ContainerStarted","Data":"d9a5bd7ea39ad298cd0567b572dc6b2c8c6c6322d6e5f956e9698f6687fb25f9"}
Nov 02 20:33:37.909508 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:37.909371    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" event={"ID":"0b61ffb6-77e1-4618-a948-4c8d19fdc95a","Type":"ContainerStarted","Data":"d5090f39cd941e3abd904b29f15047f870031aef2ed250dd923282d0639ea9bd"}
Nov 02 20:33:38.053600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:38.053530    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podStartSLOduration=2.053516166 podStartE2EDuration="2.053516166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:33:38.053067133 +0000 UTC m=+1084.991456219" watchObservedRunningTime="2026-11-02 20:33:38.053516166 +0000 UTC m=+1084.991905234"
Nov 02 20:33:38.600710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:38.596991    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:38.613901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:38.612849    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:38.613901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:38.612934    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:39.609760 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:39.609724    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:39.610320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:39.610289    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:40.594710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:40.594005    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:40.594710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:40.594065    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:41.593710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:41.593026    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:41.593710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:41.593097    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:42.614638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:42.614599    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:42.615175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:42.614721    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:43.591924 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:43.591851    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:33:43.592080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:43.591939    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:33:44.596488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:44.596457    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:44.597001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:44.596891    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:44.597639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:44.597617    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:33:53.807591 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:33:53.807550    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:33:55.630039 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.630006    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:33:55.633910 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.633886    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714345 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714313    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714527 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714356    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714527 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714384    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714647 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714598    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714781    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.714843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.714806    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmxk\" (UniqueName: \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.728587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.728558    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bce768\"/\"kube-root-ca.crt\""
Nov 02 20:33:55.728757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.728611    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bce768\"/\"openshift-service-ca.crt\""
Nov 02 20:33:55.728757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.728682    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bce768\"/\"distinct-2-w4-bce768-kserve-self-signed-certs\""
Nov 02 20:33:55.728757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.728731    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bce768\"/\"default-dockercfg-jb4t8\""
Nov 02 20:33:55.730576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.730555    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816355    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816414    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816452    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816521    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816640    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.816664    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmxk\" (UniqueName: \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.817639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.817285    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.818569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.818541    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.818819 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.818787    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.822187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.822167    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.822673 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.822635    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.874650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.874616    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmxk\" (UniqueName: \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\") pod \"distinct-2-w4-bce768-kserve-5cfb84467f-gst5s\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") " pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:55.946029 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:55.945987    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:56.401629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:56.401596    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:33:56.404813 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:33:56.404787    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda03e6104_43fb_44b2_a69d_ba37875a5338.slice/crio-56492de8a8fe61caddb11ac262d7eee255159c4b2655e6dc1f075a2862b71e56 WatchSource:0}: Error finding container 56492de8a8fe61caddb11ac262d7eee255159c4b2655e6dc1f075a2862b71e56: Status 404 returned error can't find the container with id 56492de8a8fe61caddb11ac262d7eee255159c4b2655e6dc1f075a2862b71e56
Nov 02 20:33:57.034142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:57.034109    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" event={"ID":"a03e6104-43fb-44b2-a69d-ba37875a5338","Type":"ContainerStarted","Data":"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"}
Nov 02 20:33:57.034551 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:57.034153    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" event={"ID":"a03e6104-43fb-44b2-a69d-ba37875a5338","Type":"ContainerStarted","Data":"56492de8a8fe61caddb11ac262d7eee255159c4b2655e6dc1f075a2862b71e56"}
Nov 02 20:33:57.144462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:57.144413    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podStartSLOduration=2.144399745 podStartE2EDuration="2.144399745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:33:57.142823411 +0000 UTC m=+1104.081212490" watchObservedRunningTime="2026-11-02 20:33:57.144399745 +0000 UTC m=+1104.082788813"
Nov 02 20:33:57.946213 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:57.946181    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:33:59.941867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:59.941838    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:33:59.945799 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:59.945778    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:33:59.994370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:33:59.994339    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-2250b4-openshift-default-dockercfg-qrvc5\""
Nov 02 20:34:00.053301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.053274    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:34:00.064125 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064093    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064307 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064163    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064307 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064226    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8dq\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064429 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064332    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064430    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064446    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064466    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064487    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.064775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.064657    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.172564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.172527    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.176244 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.176218    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.176413 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.176399    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.176520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.176505    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.176675 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.176662    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.176882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.176862    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.177077 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.177054    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.177179 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.177165    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8dq\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.177326 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.177313    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.177932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.177864    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.178158 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.178121    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.178831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.178810    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.179370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.179350    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.186895 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.186859    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.193468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.193400    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.193757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.193729    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.235364 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.235331    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.235518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.235498    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8dq\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.259398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.259374    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:00.676810 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.676748    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:34:00.679264 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:34:00.679230    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb49dead_b4d5_4027_bee8_16521a1f5b87.slice/crio-763af76849ef40322dc807b14c468e7900e00a86db8d905d4d7da01191eeeebd WatchSource:0}: Error finding container 763af76849ef40322dc807b14c468e7900e00a86db8d905d4d7da01191eeeebd: Status 404 returned error can't find the container with id 763af76849ef40322dc807b14c468e7900e00a86db8d905d4d7da01191eeeebd
Nov 02 20:34:00.681874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.681840    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:00.681989 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.681903    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:00.681989 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:00.681935    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:01.055479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.055386    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:34:01.056291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.056268    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" event={"ID":"bb49dead-b4d5-4027-bee8-16521a1f5b87","Type":"ContainerStarted","Data":"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"}
Nov 02 20:34:01.056378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.056308    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" event={"ID":"bb49dead-b4d5-4027-bee8-16521a1f5b87","Type":"ContainerStarted","Data":"763af76849ef40322dc807b14c468e7900e00a86db8d905d4d7da01191eeeebd"}
Nov 02 20:34:01.170723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.170660    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podStartSLOduration=2.170644534 podStartE2EDuration="2.170644534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:34:01.168828346 +0000 UTC m=+1108.107217425" watchObservedRunningTime="2026-11-02 20:34:01.170644534 +0000 UTC m=+1108.109033602"
Nov 02 20:34:01.260280 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.260246    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:01.261523 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.261487    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:01.261657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:01.261566    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:02.260284 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:02.260246    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:02.260713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:02.260298    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:03.259968 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:03.259929    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:03.260161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:03.259982    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:04.259735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:04.259703    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:04.260109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:04.259749    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:04.955430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:04.955395    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:34:04.959219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:04.959202    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.014094 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.014050    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-30ee89-openshift-default-dockercfg-xj9qc\""
Nov 02 20:34:05.052326 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052293    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052344    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052404    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052425    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052468    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052537    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052572    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052589    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgpl\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.052793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.052702    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.065798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.065771    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:34:05.157584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.157522    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.158906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.158877    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159059    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159173    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgpl\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159346 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159332    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159493    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159671 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159657    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159785 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159773    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.159858 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159848    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.160021 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.159992    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.161651 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.160499    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.161901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.160650    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.162202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.160850    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.162313 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.161592    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.172980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.172956    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.174379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.174354    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.218060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.217953    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgpl\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.218242 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.218222    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.259958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.259926    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:05.260403 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.259982    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:05.273293 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.273262    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:05.722374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.722342    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:34:05.726152 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:34:05.726117    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f54be96_9715_4734_bde6_8792bd1faf9a.slice/crio-2cb77d3b21e047620f1eff33163949e5e5f127119fd375adc40a6bad478c48a8 WatchSource:0}: Error finding container 2cb77d3b21e047620f1eff33163949e5e5f127119fd375adc40a6bad478c48a8: Status 404 returned error can't find the container with id 2cb77d3b21e047620f1eff33163949e5e5f127119fd375adc40a6bad478c48a8
Nov 02 20:34:05.728455 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.728422    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:05.728548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.728488    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:05.728548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.728516    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:05.902428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.902388    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:34:05.911862 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.911834    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.946469 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.946438    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:34:05.959020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.958992    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:34:05.963602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.963580    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-61cdc1-openshift-default-dockercfg-4zg5g\""
Nov 02 20:34:05.966163 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.966140    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:34:05.972569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.972543    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.972649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.972596    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks58r\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.972728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.972712    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.972835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.972820    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.972985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.972948    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.973061 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.973006    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.973118 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.973103    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.973183 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.973163    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:05.973250 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:05.973234    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.074710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074644    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.074919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074731    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.074919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074771    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks58r\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.074919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074883    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074919    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074964    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.074993    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075035    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075076    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075125    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075372    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075471 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075406    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075573 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075554    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.075608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.075570    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.077374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.077342    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.077457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.077387    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.084326 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.084291    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" event={"ID":"7f54be96-9715-4734-bde6-8792bd1faf9a","Type":"ContainerStarted","Data":"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"}
Nov 02 20:34:06.084420 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.084356    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" event={"ID":"7f54be96-9715-4734-bde6-8792bd1faf9a","Type":"ContainerStarted","Data":"2cb77d3b21e047620f1eff33163949e5e5f127119fd375adc40a6bad478c48a8"}
Nov 02 20:34:06.128256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.127283    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:34:06.134566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.134534    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.134725 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.134662    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks58r\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\") pod \"e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") " pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.231747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.231650    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:06.267457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.264736    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:06.267457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.264799    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:06.277972 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.277865    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:06.278512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.278450    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:06.278798 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.278745    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:06.375492 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.375437    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podStartSLOduration=2.375419434 podStartE2EDuration="2.375419434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:34:06.370141688 +0000 UTC m=+1113.308530759" watchObservedRunningTime="2026-11-02 20:34:06.375419434 +0000 UTC m=+1113.313808504"
Nov 02 20:34:06.658228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.658175    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:34:06.660753 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:34:06.660717    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e03be6_3379_442b_a801_3f198824aa55.slice/crio-fd1d9ac7db5d307306cb21bed3bd8553fd91b3536512baf1d44ddd055b16bd91 WatchSource:0}: Error finding container fd1d9ac7db5d307306cb21bed3bd8553fd91b3536512baf1d44ddd055b16bd91: Status 404 returned error can't find the container with id fd1d9ac7db5d307306cb21bed3bd8553fd91b3536512baf1d44ddd055b16bd91
Nov 02 20:34:06.663281 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.663247    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:06.663373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.663315    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:06.663373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:06.663344    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:34:07.106764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.104665    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" event={"ID":"f9e03be6-3379-442b-a801-3f198824aa55","Type":"ContainerStarted","Data":"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"}
Nov 02 20:34:07.106764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.104743    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" event={"ID":"f9e03be6-3379-442b-a801-3f198824aa55","Type":"ContainerStarted","Data":"fd1d9ac7db5d307306cb21bed3bd8553fd91b3536512baf1d44ddd055b16bd91"}
Nov 02 20:34:07.231980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.231940    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:07.233617 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.232741    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podStartSLOduration=2.23272296 podStartE2EDuration="2.23272296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:34:07.217247675 +0000 UTC m=+1114.155636793" watchObservedRunningTime="2026-11-02 20:34:07.23272296 +0000 UTC m=+1114.171112028"
Nov 02 20:34:07.233807 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.233649    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:07.233807 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.233731    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:07.260200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.260161    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 02 20:34:07.260383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.260262    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 02 20:34:07.274455 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.274415    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:07.274935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:07.274474    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:08.238187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.238145    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:08.238485 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.238453    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:08.264650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.264626    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:08.265094 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.265072    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:08.265781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.265761    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:34:08.273948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.273928    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:08.274031 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:08.273983    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:09.234179 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:09.234141    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:09.234781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:09.234748    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:09.273767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:09.273737    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:09.273918 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:09.273788    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:10.232711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:10.232081    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:10.232711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:10.232142    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:10.274557 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:10.274521    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:10.274987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:10.274588    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:11.236715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:11.233844    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:11.236715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:11.233909    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:11.273759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:11.273719    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:11.273911 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:11.273774    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:12.232297 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:12.232257    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:12.232669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:12.232327    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:12.274231 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:12.274198    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 02 20:34:12.274406 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:12.274256    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 02 20:34:13.233002 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:13.232969    5457 patch_prober.go:29] interesting pod/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 02 20:34:13.233375 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:13.233027    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 02 20:34:13.278796 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:13.278769    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:13.279125 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:13.279104    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:13.279928 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:13.279911    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:34:14.236845 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:14.236816    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:14.237259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:14.237095    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:14.237678 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:14.237654    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:34:23.808473 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:34:23.808366    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:34:29.088918 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:29.088877    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:34:53.808150 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:34:53.808112    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:34:57.243060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:34:57.243022    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:35:20.838155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.838078    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:35:20.841844 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.841822    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.903408 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.903376    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:35:20.932162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932131    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932179    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932207    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932309    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84k9\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932354    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932378    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932498    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932596    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:20.932719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:20.932658    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033456    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033513    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033570    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033598    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033649    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b84k9\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033718    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033744    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033789    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.033892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.033863    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.034261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.034228    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.034386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.034294    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.034386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.034332    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.034386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.034377    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.034564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.034446    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.036110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.036087    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.036202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.036131    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.091238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.091174    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.091362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.091283    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84k9\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.155352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.155316    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:21.165726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.163349    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:35:21.169965 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.169937    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.192986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.192959    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:35:21.196579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.196558    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.235203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.235169    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:35:21.235942 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.235911    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.235991    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236026    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236058    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236099    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236141    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236202    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gswrp\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236461 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236437    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.236534 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.236483    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.270414 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.270373    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:35:21.338007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.337970    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338013    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338035    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338152    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338266 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338210    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338340 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338323    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctdb\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338377 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338356    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338381    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338561 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338539    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338595    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338624    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338648    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338670    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338725    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338764    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338806    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338836    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.338956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338888    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gswrp\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.338956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.338925    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.339155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.339051    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.339155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.339111    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.339390 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.339366    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.339436 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.339372    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.340724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.340700    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.341159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.341137    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.398142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.398117    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.398319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.398245    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gswrp\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.439929 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.439902    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440088 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.439940    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440088 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.439998    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440088 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440084    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440122    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440156    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440195    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440267    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctdb\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440305    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440321    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440415    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440543    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.440629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.440543    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.441058 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.441039    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.442439 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.442419    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.442678 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.442660    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.494932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.494909    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:21.497014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.496988    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.497136 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.497117    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctdb\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\") pod \"e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") " pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.513168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.513146    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:21.585031 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.584028    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:35:21.594467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.594045    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.594467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.594121    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.594467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.594154    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.868928 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.868898    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:35:21.871060 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:35:21.871034    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20eac7b_4a50_467b_9131_e8093629b786.slice/crio-070ba598b6f3740d12a60cc086a230e6753f22f1d0539581ad3848441d6c1078 WatchSource:0}: Error finding container 070ba598b6f3740d12a60cc086a230e6753f22f1d0539581ad3848441d6c1078: Status 404 returned error can't find the container with id 070ba598b6f3740d12a60cc086a230e6753f22f1d0539581ad3848441d6c1078
Nov 02 20:35:21.873440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.873406    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.873564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.873496    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.873629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.873567    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.914379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.914351    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:35:21.917168 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:35:21.917144    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4744b4_2b2d_43ba_8837_4717b1c913f1.slice/crio-17f7dde0e0b636686bab92741d104b17a0a9c883d562a0ea0c5a1371f311f141 WatchSource:0}: Error finding container 17f7dde0e0b636686bab92741d104b17a0a9c883d562a0ea0c5a1371f311f141: Status 404 returned error can't find the container with id 17f7dde0e0b636686bab92741d104b17a0a9c883d562a0ea0c5a1371f311f141
Nov 02 20:35:21.921147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.920989    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.921147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.921075    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:21.921147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:21.921121    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:35:22.635990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.635949    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" event={"ID":"c20eac7b-4a50-467b-9131-e8093629b786","Type":"ContainerStarted","Data":"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"}
Nov 02 20:35:22.636183 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.636052    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" event={"ID":"c20eac7b-4a50-467b-9131-e8093629b786","Type":"ContainerStarted","Data":"070ba598b6f3740d12a60cc086a230e6753f22f1d0539581ad3848441d6c1078"}
Nov 02 20:35:22.638926 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.638861    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" event={"ID":"ae4744b4-2b2d-43ba-8837-4717b1c913f1","Type":"ContainerStarted","Data":"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"}
Nov 02 20:35:22.639113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.639096    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" event={"ID":"ae4744b4-2b2d-43ba-8837-4717b1c913f1","Type":"ContainerStarted","Data":"17f7dde0e0b636686bab92741d104b17a0a9c883d562a0ea0c5a1371f311f141"}
Nov 02 20:35:22.640914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.640890    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" event={"ID":"85a12728-56b0-4278-a34b-9e9fae947fad","Type":"ContainerStarted","Data":"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"}
Nov 02 20:35:22.641015 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.640935    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" event={"ID":"85a12728-56b0-4278-a34b-9e9fae947fad","Type":"ContainerStarted","Data":"73f3acb1d25846b6f1efc20973311dd94d982de01401f5501d796ef69df8a236"}
Nov 02 20:35:22.751160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.751094    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podStartSLOduration=1.751076686 podStartE2EDuration="1.751076686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:35:22.750373128 +0000 UTC m=+1189.688762198" watchObservedRunningTime="2026-11-02 20:35:22.751076686 +0000 UTC m=+1189.689465757"
Nov 02 20:35:22.874300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:22.874216    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podStartSLOduration=1.874196757 podStartE2EDuration="1.874196757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:35:22.871014457 +0000 UTC m=+1189.809403524" watchObservedRunningTime="2026-11-02 20:35:22.874196757 +0000 UTC m=+1189.812585827"
Nov 02 20:35:23.185862 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.185823    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:23.186154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.186124    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:23.248710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.244098    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:23.511768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.498802    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:23.511768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.498980    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:23.511768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.499024    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:23.519709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.517313    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:23.519709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.517435    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:23.519709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:23.517478    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:23.886650 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:35:23.886616    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:35:24.159766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.156142    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:24.159766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.156213    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:24.497790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.497702    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:24.498064 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.498030    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:24.515087 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.515052    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:24.515361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:24.515331    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:25.169001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.168958    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:25.169765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.169727    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:25.496084 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.495993    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:25.496427 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.496393    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:25.516118 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.516078    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:25.516377 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:25.516347    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:26.156108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.156070    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:26.157831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.157797    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:26.500769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.497002    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:26.500769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.497061    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:26.522711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.521068    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:26.522711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:26.521132    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:27.156224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.156181    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:27.156552 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.156506    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:27.496253 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.496149    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:27.496536 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.496508    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:27.514404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.514360    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:27.515027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:27.514984    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:28.156538 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.156464    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 02 20:35:28.156538 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.156525    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 02 20:35:28.495781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.495697    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 20:35:28.495937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.495770    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 20:35:28.514106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.514061    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 20:35:28.514250 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:28.514128    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 20:35:29.468029 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.467950    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podStartSLOduration=9.467930378 podStartE2EDuration="9.467930378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:35:23.000494171 +0000 UTC m=+1189.938883266" watchObservedRunningTime="2026-11-02 20:35:29.467930378 +0000 UTC m=+1196.406319471"
Nov 02 20:35:29.471194 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.471165    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:35:29.598783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.598751    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:29.600110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.600089    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:29.600877 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.600858    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:35:29.712194 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.712162    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:29.712763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.712745    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:29.713586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.713564    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:35:29.738943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.738858    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:29.739482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.739456    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:29.740331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:29.740311    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:35:33.336131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:33.336104    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:35:33.338386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:35:33.338352    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:35:53.811046 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:35:53.810994    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:36:05.869742 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.869659    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:36:05.874243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.874225    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954238    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954316    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954421    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954447    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954526    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954554    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954592    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954640    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:05.954795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:05.954780    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs25p\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.055641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.055596    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.055823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.055729    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.055823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.055766    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.055912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.055825    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.055991 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.055968    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056049 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056034    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056061    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056131    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056137    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs25p\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056255 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056217    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056393 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056367    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056567    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056737 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056627    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.056835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.056815    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.058347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.058325    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.058501 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.058485    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.082725 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.078927    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:36:06.113017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.112985    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs25p\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.113147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.112991    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.187375 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.187343    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:06.606128 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.606028    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:36:06.609137 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:36:06.609106    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1964ee_b352_4221_af60_c4e16b40f880.slice/crio-7d6bee03db0f0f5bde43b8597bd3cf4d5efde946418a496397fe0c116634bce6 WatchSource:0}: Error finding container 7d6bee03db0f0f5bde43b8597bd3cf4d5efde946418a496397fe0c116634bce6: Status 404 returned error can't find the container with id 7d6bee03db0f0f5bde43b8597bd3cf4d5efde946418a496397fe0c116634bce6
Nov 02 20:36:06.611504 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.611473    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:06.611598 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.611549    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:06.611656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:06.611592    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:07.033124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.033079    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" event={"ID":"8b1964ee-b352-4221-af60-c4e16b40f880","Type":"ContainerStarted","Data":"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"}
Nov 02 20:36:07.033623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.033180    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" event={"ID":"8b1964ee-b352-4221-af60-c4e16b40f880","Type":"ContainerStarted","Data":"7d6bee03db0f0f5bde43b8597bd3cf4d5efde946418a496397fe0c116634bce6"}
Nov 02 20:36:07.150586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.150520    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podStartSLOduration=2.150504774 podStartE2EDuration="2.150504774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:36:07.148538073 +0000 UTC m=+1234.086927142" watchObservedRunningTime="2026-11-02 20:36:07.150504774 +0000 UTC m=+1234.088893922"
Nov 02 20:36:07.188113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.188088    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:07.195712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.192789    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:07.195712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:07.192850    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:08.187935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:08.187901    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:08.188321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:08.187950    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:09.187977 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:09.187937    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:09.188398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:09.187994    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:10.192717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:10.188669    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:10.192717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:10.188751    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:11.188237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:11.188203    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:11.188493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:11.188253    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:12.188014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:12.187980    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:12.188467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:12.188034    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:13.188085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:13.188045    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 20:36:13.188465 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:13.188122    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 20:36:14.192398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:14.192367    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:14.192879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:14.192743    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:14.193424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:14.193404    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:36:15.914781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:15.914748    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:36:15.918804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:15.918786    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011240    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011349    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011390    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbz4n\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011438    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011470    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011559    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011704    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.011749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011740    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.012580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.011765    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.016481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.016455    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:36:16.113187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113152    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113190    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113210    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113278    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113337    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113363    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbz4n\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113410    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113742 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113508    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113742 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113629    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113784    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113825    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.113978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.113914    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.114067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.114045    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.114150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.114063    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.116217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.116193    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.116384 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.116364    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.170920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.170859    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.171024 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.170928    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbz4n\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.232769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.232748    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:16.651591 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.651568    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:36:16.654576 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:36:16.654548    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8237f4_e8a0_4094_a59d_598d1835652e.slice/crio-6fd378950d70778e6870e563b617cf8f0e78297078f1f9ac19478d904ebc678c WatchSource:0}: Error finding container 6fd378950d70778e6870e563b617cf8f0e78297078f1f9ac19478d904ebc678c: Status 404 returned error can't find the container with id 6fd378950d70778e6870e563b617cf8f0e78297078f1f9ac19478d904ebc678c
Nov 02 20:36:16.657152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.657116    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:16.657232 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.657187    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:16.657232 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:16.657214    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:17.089729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.089605    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" event={"ID":"ae8237f4-e8a0-4094-a59d-598d1835652e","Type":"ContainerStarted","Data":"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"}
Nov 02 20:36:17.090147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.089739    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" event={"ID":"ae8237f4-e8a0-4094-a59d-598d1835652e","Type":"ContainerStarted","Data":"6fd378950d70778e6870e563b617cf8f0e78297078f1f9ac19478d904ebc678c"}
Nov 02 20:36:17.202914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.202866    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podStartSLOduration=2.2028531239999998 podStartE2EDuration="2.202853124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:36:17.201599818 +0000 UTC m=+1244.139988887" watchObservedRunningTime="2026-11-02 20:36:17.202853124 +0000 UTC m=+1244.141242193"
Nov 02 20:36:17.233387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.233357    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:17.235069 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.235042    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:17.235193 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:17.235087    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:18.233755 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:18.233716    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:18.234127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:18.233783    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:19.233948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:19.233913    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:19.234349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:19.233967    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:20.233301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:20.233266    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:20.233481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:20.233327    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:20.470327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:20.470292    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:36:21.239718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:21.237073    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:21.239718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:21.237136    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:22.242713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:22.234384    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:22.242713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:22.234451    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:23.025712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.024788    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.245712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.244701    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:23.245712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.244774    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:23.259713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.251771    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.443921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.443858    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.482908 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.482842    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.632793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.632745    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.777815 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.777707    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.828809 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.828756    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/health\": context deadline exceeded"
Nov 02 20:36:23.852606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.852567    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:23.876258 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:36:23.876180    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:36:23.992767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:23.991797    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:24.132439 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.131867    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:24.271711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.268141    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 20:36:24.271711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.268214    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 20:36:24.292713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.284425    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:36:24.303745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.293313    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:36:24.482761 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.481254    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:24.643484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:24.643451    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:36:25.572895 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:25.572854    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:25.575218 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:25.575193    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:25.576166 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:25.576142    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:36:36.416604 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.416569    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:36:36.421910 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.421888    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445026    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445183 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445058    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445183 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445112    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445276 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445242    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445298    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72h79\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445396    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445454    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445597    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.445680 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.445655    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547323    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547358    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547398    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547432    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547464    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72h79\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547505    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547546    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547621    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547677    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547780    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.547889 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.547871    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.548093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.548059    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.548153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.548122    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.548205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.548146    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.550051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.550025    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.550566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.550542    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.604330 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.604300    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.604447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.604375    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72h79\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\") pod \"e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") " pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:36.615300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.615273    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:36:36.736507 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:36.736422    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:37.221215 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.221143    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:36:37.223593 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:36:37.223564    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf017c6f_7385_4244_b289_80401550e98f.slice/crio-f0a10ee64446ef36764e6e43e4b7ae447e0ffc75f03204d9229b528ed4b3b56f WatchSource:0}: Error finding container f0a10ee64446ef36764e6e43e4b7ae447e0ffc75f03204d9229b528ed4b3b56f: Status 404 returned error can't find the container with id f0a10ee64446ef36764e6e43e4b7ae447e0ffc75f03204d9229b528ed4b3b56f
Nov 02 20:36:37.226171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.226137    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:37.226267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.226242    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:37.226330 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.226286    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:37.277035 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.277011    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:36:37.280815 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.280796    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.315634 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.315596    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" event={"ID":"cf017c6f-7385-4244-b289-80401550e98f","Type":"ContainerStarted","Data":"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"}
Nov 02 20:36:37.315802 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.315661    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" event={"ID":"cf017c6f-7385-4244-b289-80401550e98f","Type":"ContainerStarted","Data":"f0a10ee64446ef36764e6e43e4b7ae447e0ffc75f03204d9229b528ed4b3b56f"}
Nov 02 20:36:37.341321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.341294    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-694cee-openshift-default-dockercfg-tv8jc\""
Nov 02 20:36:37.357614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357583    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357639    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357681    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plswz\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357751    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357837    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357892    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.357978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.357927    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.358102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.358080    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.358168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.358151    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.382984 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.382954    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:36:37.459200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459160    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459205    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459226    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plswz\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459251    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459301    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459347    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459375    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459473    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459537    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459609    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.459822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459696    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.460279 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.459942    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.460279 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.460207    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.460447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.460346    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.461873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.461848    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.462265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.462246    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.516341 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.516268    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.516499 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.516350    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plswz\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.532870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.532803    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podStartSLOduration=1.532789149 podStartE2EDuration="1.532789149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:36:37.531051008 +0000 UTC m=+1264.469440111" watchObservedRunningTime="2026-11-02 20:36:37.532789149 +0000 UTC m=+1264.471178216"
Nov 02 20:36:37.594755 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.594712    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:37.738826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:37.738291    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:38.038071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.038045    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:36:38.040562 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:36:38.040469    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d19441a_6597_4b81_ba45_38cee8ba5e46.slice/crio-4504f5da377ea4c9161ef9b817e10f03e19129c47cd894762770369efdca54e2 WatchSource:0}: Error finding container 4504f5da377ea4c9161ef9b817e10f03e19129c47cd894762770369efdca54e2: Status 404 returned error can't find the container with id 4504f5da377ea4c9161ef9b817e10f03e19129c47cd894762770369efdca54e2
Nov 02 20:36:38.043597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.043552    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:38.043700 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.043651    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:38.043752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.043711    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:36:38.327831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.327741    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" event={"ID":"0d19441a-6597-4b81-ba45-38cee8ba5e46","Type":"ContainerStarted","Data":"93de0b2f870c5262edc39ed1c1ca19ecc39c76791f97a2fc183182e249b71f6f"}
Nov 02 20:36:38.327831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.327813    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" event={"ID":"0d19441a-6597-4b81-ba45-38cee8ba5e46","Type":"ContainerStarted","Data":"4504f5da377ea4c9161ef9b817e10f03e19129c47cd894762770369efdca54e2"}
Nov 02 20:36:38.445256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.445192    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podStartSLOduration=1.445173742 podStartE2EDuration="1.445173742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:36:38.442800892 +0000 UTC m=+1265.381189982" watchObservedRunningTime="2026-11-02 20:36:38.445173742 +0000 UTC m=+1265.383562815"
Nov 02 20:36:38.598762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.594772    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:38.738711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.738412    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:38.738711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:38.738477    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:39.617711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:39.614251    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:39.624706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:39.620760    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:39.742140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:39.742101    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:39.742421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:39.742389    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:40.600711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:40.597045    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:40.600711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:40.597108    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:40.738115 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:40.738070    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:40.738720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:40.738659    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:41.606712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:41.597053    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:41.606712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:41.597127    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:41.740830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:41.740791    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:41.741315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:41.741287    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:42.601709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:42.596268    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:42.601709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:42.596337    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:42.739823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:42.739789    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:42.740059 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:42.740035    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:43.598759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:43.598050    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:43.598759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:43.598127    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:43.737162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:43.737128    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 20:36:43.737348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:43.737182    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 20:36:44.595703 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:44.595649    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 02 20:36:44.595908 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:44.595728    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 02 20:36:44.741932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:44.741900    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:44.742408 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:44.742166    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:44.742723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:44.742673    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:36:45.599921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:45.599889    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:45.600309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:45.600286    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:45.601025 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:45.601006    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:36:53.808146 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:36:53.808109    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:36:57.641110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:57.640866    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:57.672515 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:57.672464    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:57.849710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:57.825784    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:57.920779 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:57.911800    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:57.937162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:57.937124    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:58.004173 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.003331    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": context deadline exceeded"
Nov 02 20:36:58.613711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.598918    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:36:58.633840 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.632837    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:58.645387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.642900    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:36:58.645387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.644186    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:36:58.679805 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:36:58.679775    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:37:21.433617 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.433580    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:37:21.438059 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.438031    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.532923 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.532885    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:37:21.580716 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.580640    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.580716 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.580703    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.580946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.580828    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.580946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.580882    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbq54\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.581110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.581077    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.581261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.581239    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.581365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.581279    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.581365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.581312    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.581443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.581367    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682382 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682347    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682571 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682403    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682571 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682427    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682571 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682547    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682571 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682570    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682625    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682661    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbq54\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682831    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.682920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682884    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.683041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682936    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.683041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.682966    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.683206 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.683183    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.683298 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.683205    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.683475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.683447    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.685155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.685095    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.685283 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.685266    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.740121 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.740088    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.740315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.740289    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbq54\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\") pod \"e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") " pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:21.753876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:21.753848    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:22.177577 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.177484    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:37:22.185239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.185203    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:22.185337 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.185270    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:22.185337 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.185298    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:22.631381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.631299    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" event={"ID":"21b2ea50-acc0-4361-8388-8c9b13f4c832","Type":"ContainerStarted","Data":"1f3ebff834d7ee3c6c6c9b012cacb266f56c9bbdf791a40fb7caf4a867a8b795"}
Nov 02 20:37:22.631835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.631383    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" event={"ID":"21b2ea50-acc0-4361-8388-8c9b13f4c832","Type":"ContainerStarted","Data":"1923a419feed13ccc9dab8aba7fdb242690228cc7726c59b21a7e3876fd8b47a"}
Nov 02 20:37:22.744304 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.744251    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podStartSLOduration=1.7442382539999999 podStartE2EDuration="1.744238254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:37:22.743534414 +0000 UTC m=+1309.681923464" watchObservedRunningTime="2026-11-02 20:37:22.744238254 +0000 UTC m=+1309.682627324"
Nov 02 20:37:22.754484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:22.754456    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:23.760711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:23.759513    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:23.760711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:23.759579    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:23.831733 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:37:23.831673    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:37:24.757723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:24.757245    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:24.757723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:24.757324    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:25.754865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:25.754833    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:25.755323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:25.754887    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:26.754303 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:26.754261    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:26.754480 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:26.754326    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:27.754623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:27.754583    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:27.755042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:27.754636    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:28.754765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:28.754729    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:28.755192 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:28.754799    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:28.789332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:28.789301    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:37:29.760626 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:29.760094    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 20:37:29.760626 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:29.760186    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 20:37:31.656931 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:31.645831    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:31.665759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:31.665695    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:31.804266 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:31.804084    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:31.804650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:31.804527    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:31.812773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:31.812593    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:32.829710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:32.825785    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:32.829710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:32.825874    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:32.948110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:32.946343    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:32.948110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:32.947796    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.033831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.033775    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.069711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.069041    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.117877 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.117773    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.456912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.456868    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.511709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.483523    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.703711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.673873    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:37:33.703711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.681748    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:37:33.814775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.806930    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 02 20:37:33.816301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.816250    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.867304 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.867257    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:33.867920 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.867884    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.948569 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.948523    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:33.956707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:33.952804    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:37:34.034844 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.034798    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": context deadline exceeded"
Nov 02 20:37:34.045731 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.043429    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:37:34.300517 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.300485    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:37:34.527456 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.527402    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Nov 02 20:37:34.528117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.528092    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:37:34.550285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.550246    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/health\": context deadline exceeded"
Nov 02 20:37:34.550649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.550586    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.575939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.575894    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.576613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.576591    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:37:34.679029 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.678987    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.680252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.680227    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:37:34.682375 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.682346    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.682856 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.682838    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:37:34.836790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.811975    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.859714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.837090    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:37:34.988711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.964390    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:34.996709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.973662    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:35.021717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:34.996966    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:35.119939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.119817    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:35.237796 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.237740    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:35.552836 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.552790    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:35.610713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.587980    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:35.809763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.790808    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:37:35.892142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.838837    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.020774 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:35.854720    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.071038 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.070950    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:37:36.094709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.071930    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:37:36.133715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.132206    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.177752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.153848    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:37:36.250710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.238399    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:37:36.250710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.238476    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.348995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.321052    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.589869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.589817    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.623763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.603997    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:37:36.646225 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.640715    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.740714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.729992    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:36.753574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.749736    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:36.762702 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.760441    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:37:36.773367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.773338    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:37:36.893850 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.892758    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:37:36.901715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.901026    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:37:36.907223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.907201    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:37:36.985953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:36.985354    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:37:37.013321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:37.011975    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:37:38.397146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:38.397115    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:37:38.398055 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:38.398022    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy" containerID="cri-o://380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735" gracePeriod=30
Nov 02 20:37:43.761921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.761886    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:37:43.844290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.844260    5457 generic.go:356] "Generic (PLEG): container finished" podID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerID="380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735" exitCode=0
Nov 02 20:37:43.844452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.844298    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" event={"ID":"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e","Type":"ContainerDied","Data":"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"}
Nov 02 20:37:43.844452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.844306    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"
Nov 02 20:37:43.844452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.844344    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v" event={"ID":"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e","Type":"ContainerDied","Data":"e76d953ae50987f3213128ed06f0d9aa8b4088ff9bc75d8496dc3a97ac31a48d"}
Nov 02 20:37:43.844452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.844367    5457 scope.go:122] "RemoveContainer" containerID="380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"
Nov 02 20:37:43.846726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.846702    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.846825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.846737    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.846825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.846771    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.846962 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.846945    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847003    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:37:43.847076 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847023    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847103    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847170    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847204    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847263    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\") pod \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\" (UID: \"1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e\") "
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847098    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847373    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847409    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847588    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847776    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847790    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847805    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847816    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.847890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.847825    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.849846 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.849814    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:37:43.849955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.849845    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "kube-api-access-49nwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:37:43.849955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.849873    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:37:43.850435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.850418    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy" pod "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" (UID: "1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:37:43.871430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.871407    5457 scope.go:122] "RemoveContainer" containerID="380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"
Nov 02 20:37:43.871813 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:37:43.871794    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735\": container with ID starting with 380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735 not found: ID does not exist" containerID="380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"
Nov 02 20:37:43.871868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.871825    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735"} err="failed to get container status \"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735\": rpc error: code = NotFound desc = could not find container \"380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735\": container with ID starting with 380e73fe72801d91ab5c4391cb028273dfce6556704f4ba03dd8ac40e7c25735 not found: ID does not exist"
Nov 02 20:37:43.949553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.949459    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.949553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.949497    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.949553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.949510    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49nwm\" (UniqueName: \"kubernetes.io/projected/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-kube-api-access-49nwm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:43.949553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:43.949522    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:37:44.264670 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:44.264583    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:37:44.268440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:44.268408    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-gjf7v"]
Nov 02 20:37:45.176867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:45.176827    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" path="/var/lib/kubelet/pods/1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e/volumes"
Nov 02 20:37:52.825240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.825205    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:37:52.825812 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.825796    5457 cpu_manager.go:414] "containerMap: removing container" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy"
Nov 02 20:37:52.825860 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.825813    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy"
Nov 02 20:37:52.825935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.825926    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="1cb7dcf6-4bf3-4e1b-8679-dc8e527de37e" containerName="istio-proxy"
Nov 02 20:37:52.829165 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.829145    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.871480 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.871442    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:37:52.875188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.875168    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.917370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.917337    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:37:52.942724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.942668    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:37:52.976574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976538    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.976817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976607    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.976817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976667    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.976817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976727    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.976817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976772    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976859    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976878    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976894    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.976921    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mb7\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977054 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977060    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977125    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9d6w\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977188    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977256    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977293    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977333    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977360    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:52.977732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977431    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:52.977732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:52.977479    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078437    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078500    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078549    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078586    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078605    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078626    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078676    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078744    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078767    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078790    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.078820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078821    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84mb7\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078861    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078910    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9d6w\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078916    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078949    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.078990    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079050    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079084    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079131    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079159    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079487    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079491    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079543    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079569    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079593    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.079907 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.079873    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.080209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.080189    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.080247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.080196    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.081937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.081911    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.082161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.082086    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.082161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.082118    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.082291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.082235    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.139191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.139160    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.145556 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.145526    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.145965 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.145941    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9d6w\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.146019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.145964    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mb7\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\") pod \"e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") " pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.155813 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.155786    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:37:53.161124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.161103    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.189635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.189606    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:53.220665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.220632    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:37:53.282450 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282408    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.282606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282568    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.282606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282597    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.282704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282654    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.282829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282809    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.284019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.282970    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbgsm\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.284019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.283062    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.284019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.283089    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.284019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.283131    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384653    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384777    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbgsm\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384826    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384843    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384884    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.384979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.384942    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385055    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385122 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385080    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385122 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385107    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385131    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385375 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385346    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385438    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385463    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.385843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.385826    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.387073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.387058    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.387315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.387282    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.441694 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.441651    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.441817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.441704    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbgsm\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\") pod \"e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") " pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.444564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.444548    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:53.474649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.474625    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:53.616943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.615273    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:37:53.619796 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:37:53.619765    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36b88af_e35a_4f37_832e_d8ce49ecd03d.slice/crio-2a7506186079baa2b8f40ddc061677c03b3bd018a91779c92ef425de28e6d4c9 WatchSource:0}: Error finding container 2a7506186079baa2b8f40ddc061677c03b3bd018a91779c92ef425de28e6d4c9: Status 404 returned error can't find the container with id 2a7506186079baa2b8f40ddc061677c03b3bd018a91779c92ef425de28e6d4c9
Nov 02 20:37:53.622855 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.622811    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.622949 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.622902    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.622987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.622947    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.817359 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:37:53.814998    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:37:53.827061 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.826395    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:37:53.829210 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:37:53.829160    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2642f097_32a6_4c1a_9ae6_03b9424e845c.slice/crio-21030cf1700970cde39306b1c75f4b055e0e8f956d069096f848620bf3715c29 WatchSource:0}: Error finding container 21030cf1700970cde39306b1c75f4b055e0e8f956d069096f848620bf3715c29: Status 404 returned error can't find the container with id 21030cf1700970cde39306b1c75f4b055e0e8f956d069096f848620bf3715c29
Nov 02 20:37:53.832230 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.832187    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.832308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.832270    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.832376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.832316    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.871930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.871606    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:37:53.874594 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:37:53.874560    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a52ae4_1382_4f55_ba26_b3ae2b273f4f.slice/crio-a44a7eae0849598f9e2445d00d2ae090c6471c1ba5ab9b34a91f2f5594e0fcf4 WatchSource:0}: Error finding container a44a7eae0849598f9e2445d00d2ae090c6471c1ba5ab9b34a91f2f5594e0fcf4: Status 404 returned error can't find the container with id a44a7eae0849598f9e2445d00d2ae090c6471c1ba5ab9b34a91f2f5594e0fcf4
Nov 02 20:37:53.878057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.878021    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.878292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.878271    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:53.878435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:53.878418    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:37:54.044512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.044261    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" event={"ID":"a36b88af-e35a-4f37-832e-d8ce49ecd03d","Type":"ContainerStarted","Data":"a8d206d741c4642fba9ae934fa07d018ca8e209150935ea66837c8ae88e94cd0"}
Nov 02 20:37:54.044512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.044354    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" event={"ID":"a36b88af-e35a-4f37-832e-d8ce49ecd03d","Type":"ContainerStarted","Data":"2a7506186079baa2b8f40ddc061677c03b3bd018a91779c92ef425de28e6d4c9"}
Nov 02 20:37:54.047760 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.047672    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" event={"ID":"46a52ae4-1382-4f55-ba26-b3ae2b273f4f","Type":"ContainerStarted","Data":"a44a7eae0849598f9e2445d00d2ae090c6471c1ba5ab9b34a91f2f5594e0fcf4"}
Nov 02 20:37:54.057347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.057314    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" event={"ID":"2642f097-32a6-4c1a-9ae6-03b9424e845c","Type":"ContainerStarted","Data":"e9816881c7c1b3b3cf680625bc60a1dda6c0dae3ab00fa8c2cf5e3921667cc66"}
Nov 02 20:37:54.057553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.057538    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" event={"ID":"2642f097-32a6-4c1a-9ae6-03b9424e845c","Type":"ContainerStarted","Data":"21030cf1700970cde39306b1c75f4b055e0e8f956d069096f848620bf3715c29"}
Nov 02 20:37:54.194708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.191486    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:37:54.194708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.191618    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:54.194708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.191660    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:54.286347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.286232    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podStartSLOduration=2.286213604 podStartE2EDuration="2.286213604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:37:54.28397112 +0000 UTC m=+1341.222360188" watchObservedRunningTime="2026-11-02 20:37:54.286213604 +0000 UTC m=+1341.224602669"
Nov 02 20:37:54.288224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.288177    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podStartSLOduration=2.2881610549999998 podStartE2EDuration="2.288161055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:37:54.169897005 +0000 UTC m=+1341.108286077" watchObservedRunningTime="2026-11-02 20:37:54.288161055 +0000 UTC m=+1341.226550125"
Nov 02 20:37:54.445757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.445717    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:37:54.447400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.447367    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:54.447547 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:54.447423    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:55.078041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.078006    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" event={"ID":"46a52ae4-1382-4f55-ba26-b3ae2b273f4f","Type":"ContainerStarted","Data":"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"}
Nov 02 20:37:55.198276 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.197052    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:55.198276 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.197110    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:55.218709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.202957    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podStartSLOduration=2.20293759 podStartE2EDuration="2.20293759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:37:55.197825931 +0000 UTC m=+1342.136215013" watchObservedRunningTime="2026-11-02 20:37:55.20293759 +0000 UTC m=+1342.141326663"
Nov 02 20:37:55.445746 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.445112    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:55.445746 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.445176    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:55.475432 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.475381    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:37:55.476525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.476502    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:37:55.476596 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:55.476550    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:37:56.202710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.193093    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:56.202710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.193163    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:56.461767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.453363    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:56.461767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.453436    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:56.475925 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.475888    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:37:56.476083 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:56.475953    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:37:57.214202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.214164    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:57.214840 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.214808    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:57.457707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.456801    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:57.457707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.456870    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:57.475611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.475466    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:37:57.475779 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:57.475613    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:37:58.205711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.193037    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:58.205711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.193100    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:58.451185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.451142    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:58.451827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.451786    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:58.475103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.475015    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:37:58.475103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:58.475077    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:37:59.241721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.236303    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:37:59.241721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.236364    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:37:59.450708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.450137    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:37:59.450708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.450223    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:37:59.475537 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.475490    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:37:59.475950 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:37:59.475571    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:38:00.195708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.194082    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 02 20:38:00.195708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.194146    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 02 20:38:00.445332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.445291    5457 patch_prober.go:29] interesting pod/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 20:38:00.445560 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.445357    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 20:38:00.475773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.475670    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 02 20:38:00.475773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:00.475746    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 02 20:38:01.631711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.631249    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:38:01.634734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.632257    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:38:01.634734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.634074    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:38:01.735545 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.735502    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:38:01.740932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.740908    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.806954 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.806910    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.806994    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807020    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptgb5\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807104    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807211    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807241    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807265    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.807342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.807296    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.808179 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.808145    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.837233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.837124    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:38:01.898833 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.898015    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:38:01.899885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.899732    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:38:01.902440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.901351    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:38:01.910464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910427    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.910579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910520    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.910639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910577    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.910639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910604    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptgb5\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.910764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910727    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.911252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910832    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.911252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910866    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.911252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910889    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.911252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.910924    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.911858 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.911831    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.912116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.912091    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.912385 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.912360    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.912460 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.912387    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.912716 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.912696    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.918615 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.917183    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.918615 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.917749    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.938045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.938022    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:38:01.938484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.938460    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:38:01.939536 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.939518    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:38:01.968426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.968399    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:01.968533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:01.968518    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptgb5\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\") pod \"e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") " pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:02.088209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:02.088179    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:02.533279 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:02.533246    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:38:02.542747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:02.542674    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:02.542874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:02.542782    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:02.542874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:02.542812    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:03.285243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:03.285206    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" event={"ID":"f5bceef8-b171-4b4e-8700-55d9f56713ed","Type":"ContainerStarted","Data":"b9fc2e7778adc75d4581ac78ec41659b4b1a4775379fb798cf437db11c701512"}
Nov 02 20:38:03.285779 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:03.285270    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" event={"ID":"f5bceef8-b171-4b4e-8700-55d9f56713ed","Type":"ContainerStarted","Data":"1d3d211c532235927e6e04b889e15d1129b462ae2a8eefd17c799f9cf20f92d2"}
Nov 02 20:38:04.088365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:04.088329    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:04.111724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:04.111061    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:04.111724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:04.111123    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:05.113711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:05.101828    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:05.113711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:05.101891    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:06.113711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:06.107872    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:06.113711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:06.107932    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:06.841864 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:06.841795    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:06.922894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:06.921782    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.028711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.025832    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.048728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.045928    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.113764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.088705    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:07.113764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.088776    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:07.307553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.306789    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": context deadline exceeded"
Nov 02 20:38:07.525707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.524050    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.610220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.610165    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.764723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.764041    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.856472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.849172    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Nov 02 20:38:07.856472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.852844    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:38:07.856472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.852960    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.856472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.853070    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:07.917709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.914305    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.928717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.922667    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:07.928717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:07.923150    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:38:08.017709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.004193    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podStartSLOduration=7.00416679 podStartE2EDuration="7.00416679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:38:03.410805511 +0000 UTC m=+1350.349194585" watchObservedRunningTime="2026-11-02 20:38:08.00416679 +0000 UTC m=+1354.942555861"
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.059792    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.060237    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.061181    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.061545    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.091066    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:08.092711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.091121    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:08.319308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.319258    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:08.320308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.320283    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:38:08.553327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.532061    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:38:08.553327 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.539810    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:38:08.613135 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.613035    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:08.614899 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.614874    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:38:08.796854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.796817    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:08.798059 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.798028    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:38:08.850149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.850087    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:08.863320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.863233    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:38:08.919342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.919302    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:09.042255 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.938756    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:38:09.043719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:08.976615    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:09.046135 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.046114    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:38:09.146082 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.137576    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": context deadline exceeded"
Nov 02 20:38:09.176387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.169844    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:09.176387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.169910    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:09.191710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.187782    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:09.324152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.320958    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:09.541926 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.541823    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:09.812904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:09.812802    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 02 20:38:10.073776 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.059558    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Nov 02 20:38:10.142712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.117240    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:38:10.145290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.143723    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:10.145290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.145004    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:10.164673 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.163848    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:10.188995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.188941    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:10.326987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.326068    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:10.550392 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.549166    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:10.813835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.813787    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:10.860823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.860773    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Nov 02 20:38:10.921904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:10.921842    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Nov 02 20:38:11.094457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.093763    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Nov 02 20:38:11.120831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.120794    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:11.121105 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.121071    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:11.144827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.144779    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:38:11.177442 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.175501    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.203712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.198791    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.326619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.326557    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.556736 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.556663    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.628888 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.628836    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:38:11.633843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.633782    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.847553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.847110    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.892710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.891970    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.907720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.893049    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:11.930602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.930562    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:11.934900 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:11.934868    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:38:12.102051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.101962    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:12.102280 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.102250    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:12.103406 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.103375    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Nov 02 20:38:12.179542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.175591    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Nov 02 20:38:12.179840 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.179807    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.206560 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.199310    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.334442 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.333964    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.466710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.441668    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.562710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.561832    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:38:12.655711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.653376    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.862770 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.861846    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.900715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.895458    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.923441 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.923397    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:12.941936 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:12.941893    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.037004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.036885    5457 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.101277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.101227    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:13.101587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.101536    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:13.180479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.180435    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.181175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.181144    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.193604 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.193571    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.212734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.199512    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.359769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.359715    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.569795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.567909    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.668359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.668325    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:38:13.884767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.884065    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.909502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.909438    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:13.954811 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.944085    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Nov 02 20:38:13.956195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:13.956167    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:38:14.034008 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.033969    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:38:14.075329 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.075301    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:38:14.079909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.075569    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:38:14.090094 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.089988    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 02 20:38:14.090094 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.090041    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 02 20:38:14.168878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.168797    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:38:14.198138 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.198098    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Nov 02 20:38:14.234167 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.234124    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:38:14.241436 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.241156    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:14.265220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:14.265192    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:38:15.543325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:15.543293    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:15.544098 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:15.544073    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:15.545424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:15.545399    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:38:16.459447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.459413    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:38:16.463871 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.463849    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.512605 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.512572    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2b3e20d8-serving-cert\""
Nov 02 20:38:16.562077 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.562046    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:38:16.569851 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.569823    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.569980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.569860    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4zht\" (UniqueName: \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.570123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.570098    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.570322 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.570298    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.671913 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.671872    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.672075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.671915    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4zht\" (UniqueName: \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.672075 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:16.672022    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-serving-cert: secret "maas-api-e2e-ait-2b3e20d8-serving-cert" not found
Nov 02 20:38:16.672201 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:16.672090    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls podName:847b5581-d79b-483d-8843-7f56c7e99fbb nodeName:}" failed. No retries permitted until 2026-11-02 20:38:17.17207131 +0000 UTC m=+1364.110460358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls") pod "maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" (UID: "847b5581-d79b-483d-8843-7f56c7e99fbb") : secret "maas-api-e2e-ait-2b3e20d8-serving-cert" not found
Nov 02 20:38:16.672201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.672030    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.672316 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.672301    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.672944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.672924    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.674381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.674364    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:16.779757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:16.778413    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4zht\" (UniqueName: \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:17.181730 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:17.181669    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:17.184108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:17.184089    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") pod \"maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:17.377796 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:17.377764    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:17.750741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:17.750715    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:38:17.752884 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:38:17.752857    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847b5581_d79b_483d_8843_7f56c7e99fbb.slice/crio-a799e77a5c690d993785b10d1eb3ad1b2bcdb151ecb0c93fa7a28dabcdacd55e WatchSource:0}: Error finding container a799e77a5c690d993785b10d1eb3ad1b2bcdb151ecb0c93fa7a28dabcdacd55e: Status 404 returned error can't find the container with id a799e77a5c690d993785b10d1eb3ad1b2bcdb151ecb0c93fa7a28dabcdacd55e
Nov 02 20:38:17.754390 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:17.754370    5457 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:38:18.144932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:18.144892    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" event={"ID":"847b5581-d79b-483d-8843-7f56c7e99fbb","Type":"ContainerStarted","Data":"a799e77a5c690d993785b10d1eb3ad1b2bcdb151ecb0c93fa7a28dabcdacd55e"}
Nov 02 20:38:19.152984 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:19.152942    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" event={"ID":"847b5581-d79b-483d-8843-7f56c7e99fbb","Type":"ContainerStarted","Data":"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"}
Nov 02 20:38:19.153424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:19.153142    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:19.264017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:19.263964    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" podStartSLOduration=2.346206053 podStartE2EDuration="3.263950892s" totalImagesPullingTime="917.744839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:38:19.262203138 +0000 UTC m=+1366.200592209" watchObservedRunningTime="2026-11-02 20:38:19.263950892 +0000 UTC m=+1366.202339960"
Nov 02 20:38:23.809952 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:23.809914    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:38:25.164648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:25.164620    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:38:31.238662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.238622    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:38:31.244277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.244252    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.295659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.295630    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6c66f658-serving-cert\""
Nov 02 20:38:31.318976 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.318945    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.319109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.319073    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.319199 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.319181    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.319290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.319271    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqqw\" (UniqueName: \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.346385 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.346357    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:38:31.420619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.420586    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.420804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.420654    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqqw\" (UniqueName: \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.420804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.420792    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.420893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.420839    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.421004 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:31.420987    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-serving-cert: secret "maas-api-e2e-migrate-6c66f658-serving-cert" not found
Nov 02 20:38:31.421068 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:31.421057    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls podName:184f2ed5-8be7-45ae-b980-e9882c234c9f nodeName:}" failed. No retries permitted until 2026-11-02 20:38:31.921037883 +0000 UTC m=+1378.859426933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls") pod "maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" (UID: "184f2ed5-8be7-45ae-b980-e9882c234c9f") : secret "maas-api-e2e-migrate-6c66f658-serving-cert" not found
Nov 02 20:38:31.421251 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.421229    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.423233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.423214    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.478235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.478202    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqqw\" (UniqueName: \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.937191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.937152    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:31.939833 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:31.939804    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:32.158195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:32.158157    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:32.530732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:32.530695    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:38:32.533161 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:38:32.533131    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184f2ed5_8be7_45ae_b980_e9882c234c9f.slice/crio-2e530248715dae1b4893ae50e77fb259f66c15371e07bad165031a7b46e958ce WatchSource:0}: Error finding container 2e530248715dae1b4893ae50e77fb259f66c15371e07bad165031a7b46e958ce: Status 404 returned error can't find the container with id 2e530248715dae1b4893ae50e77fb259f66c15371e07bad165031a7b46e958ce
Nov 02 20:38:33.250564 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:33.250529    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" event={"ID":"184f2ed5-8be7-45ae-b980-e9882c234c9f","Type":"ContainerStarted","Data":"2e530248715dae1b4893ae50e77fb259f66c15371e07bad165031a7b46e958ce"}
Nov 02 20:38:34.258388 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:34.258350    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" event={"ID":"184f2ed5-8be7-45ae-b980-e9882c234c9f","Type":"ContainerStarted","Data":"f5a0a5095ce658ad264e48715d09beb18d0bcddea4a613cb1bf500c9769e16a7"}
Nov 02 20:38:34.258837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:34.258424    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:34.277940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:34.277902    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:38:34.368357 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:34.368298    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" podStartSLOduration=2.5240650159999998 podStartE2EDuration="3.368286032s" totalImagesPullingTime="844.221016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:38:34.367929431 +0000 UTC m=+1381.306318503" watchObservedRunningTime="2026-11-02 20:38:34.368286032 +0000 UTC m=+1381.306675102"
Nov 02 20:38:37.061073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.061016    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.109982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.109924    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.176763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.151760    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.189200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.188825    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.199830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.199769    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.382771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.371780    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.549721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.543816    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:38:37.808668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.808575    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:38:37.808960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.808926    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.827833 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.827784    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:37.966706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:37.962780    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:38.115007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.112786    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:38.115007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.113177    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:38:38.201568 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.201518    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:38.202191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.202168    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:38:38.262463 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.262433    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:38:38.435743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.425772    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:38.435743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.426569    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:38:38.435743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.429673    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:38:38.447147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.447067    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.484599    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwdgf\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.484672    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.484839    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.484869    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.484900    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.485055    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.485127    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.485173    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.489376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.485220    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.672495 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.672448    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": context deadline exceeded"
Nov 02 20:38:38.711778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.702598    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.711778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.711424    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.702679    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712130    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712194    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712347    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwdgf\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712436    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712495    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712520    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.712552    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.713237    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.713548    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.714155 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.713829    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.732420 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.724841    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:38:38.732420 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.726930    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.732420 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.727180    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.855707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.851468    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.889914 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.849506    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:38.995623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.995589    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwdgf\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:39.107940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:38.999750    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:38:39.107940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.014452    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-nqch5\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:39.107940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.058419    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:38:39.153478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.120091    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:38:39.153478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.121663    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:39.153478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.125997    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:38:39.153478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.126658    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:39.312767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.302215    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:38:39.780162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.780131    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:38:39.783383 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:38:39.783353    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3f4528_d3df_4f55_91b2_a378dc9dffc6.slice/crio-cc7d55530ac0ad1a6242557d94913af534bb4277d198a133bdcb80271dabc835 WatchSource:0}: Error finding container cc7d55530ac0ad1a6242557d94913af534bb4277d198a133bdcb80271dabc835: Status 404 returned error can't find the container with id cc7d55530ac0ad1a6242557d94913af534bb4277d198a133bdcb80271dabc835
Nov 02 20:38:39.829514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.828850    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:39.829514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.828941    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:39.829514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:39.828995    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:38:40.291359 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:40.291332    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:38:40.493378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:40.493342    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" event={"ID":"db3f4528-d3df-4f55-91b2-a378dc9dffc6","Type":"ContainerStarted","Data":"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"}
Nov 02 20:38:40.493542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:40.493402    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" event={"ID":"db3f4528-d3df-4f55-91b2-a378dc9dffc6","Type":"ContainerStarted","Data":"cc7d55530ac0ad1a6242557d94913af534bb4277d198a133bdcb80271dabc835"}
Nov 02 20:38:40.606633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:40.606533    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podStartSLOduration=2.606519382 podStartE2EDuration="2.606519382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:38:40.605950881 +0000 UTC m=+1387.544339950" watchObservedRunningTime="2026-11-02 20:38:40.606519382 +0000 UTC m=+1387.544908450"
Nov 02 20:38:41.123468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:41.123429    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:41.124640 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:41.124613    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:41.124804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:41.124668    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:42.123514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.123479    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:42.123944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.123542    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:42.217106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.217073    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:38:42.221898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.221868    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.262463 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.262431    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:38:42.271107 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.271077    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-574357e2-serving-cert\""
Nov 02 20:38:42.339539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.339507    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.339711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.339561    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.340033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.340006    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.340116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.340101    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c655x\" (UniqueName: \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.441399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.441353    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.441608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.441425    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c655x\" (UniqueName: \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.441608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.441481    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.441608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.441520    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.441799 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:42.441730    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-serving-cert: secret "maas-api-e2e-derive-574357e2-serving-cert" not found
Nov 02 20:38:42.441849 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:42.441803    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls podName:e6c4b185-0a7d-4e3b-9a05-f058812fa415 nodeName:}" failed. No retries permitted until 2026-11-02 20:38:42.941781244 +0000 UTC m=+1389.880170310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls") pod "maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" (UID: "e6c4b185-0a7d-4e3b-9a05-f058812fa415") : secret "maas-api-e2e-derive-574357e2-serving-cert" not found
Nov 02 20:38:42.442212 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.442189    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.444016 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.443994    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.528488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.528452    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c655x\" (UniqueName: \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.981734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.976579    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:42.981734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:42.981327    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") pod \"maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:43.129611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:43.129576    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:43.131157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:43.131110    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:43.138378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:43.138345    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:43.540759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:43.540718    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:38:43.542858 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:38:43.542826    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c4b185_0a7d_4e3b_9a05_f058812fa415.slice/crio-d27eaafaae743960ada7726836b674b06ac5b7dcb7109b7ca8a7cf757f6d7768 WatchSource:0}: Error finding container d27eaafaae743960ada7726836b674b06ac5b7dcb7109b7ca8a7cf757f6d7768: Status 404 returned error can't find the container with id d27eaafaae743960ada7726836b674b06ac5b7dcb7109b7ca8a7cf757f6d7768
Nov 02 20:38:43.565045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:43.565009    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" event={"ID":"e6c4b185-0a7d-4e3b-9a05-f058812fa415","Type":"ContainerStarted","Data":"d27eaafaae743960ada7726836b674b06ac5b7dcb7109b7ca8a7cf757f6d7768"}
Nov 02 20:38:44.123551 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:44.123514    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:44.123780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:44.123567    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:45.123634 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:45.123597    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:45.124111 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:45.123661    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:45.653614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:45.653563    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" event={"ID":"e6c4b185-0a7d-4e3b-9a05-f058812fa415","Type":"ContainerStarted","Data":"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"}
Nov 02 20:38:45.653897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:45.653790    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:45.765654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:45.765602    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" podStartSLOduration=2.883754899 podStartE2EDuration="3.765588332s" totalImagesPullingTime="881.833433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:38:45.763673402 +0000 UTC m=+1392.702062472" watchObservedRunningTime="2026-11-02 20:38:45.765588332 +0000 UTC m=+1392.703977401"
Nov 02 20:38:46.123447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:46.123360    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:46.123447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:46.123416    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:47.124201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:47.124163    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:47.124743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:47.124224    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:48.123294 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:48.123264    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-nqch5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 02 20:38:48.123484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:48.123315    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 02 20:38:49.152311 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:49.152279    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:49.152893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:49.152869    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:49.154127 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:49.154105    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:38:51.664706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:38:51.664660    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:38:53.808409 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:38:53.808365    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:39:09.460771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:39:09.460405    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:39:23.808087 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:39:23.808049    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:39:53.808831 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:39:53.808754    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:40:06.340451 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:06.340412    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:40:06.340919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:06.340657    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" podUID="847b5581-d79b-483d-8843-7f56c7e99fbb" containerName="maas-api" containerID="cri-o://a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e" gracePeriod=30
Nov 02 20:40:06.882734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:06.873002    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:40:07.022664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.020968    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\") pod \"847b5581-d79b-483d-8843-7f56c7e99fbb\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") "
Nov 02 20:40:07.022664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.021107    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\" (UniqueName: \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\") pod \"847b5581-d79b-483d-8843-7f56c7e99fbb\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") "
Nov 02 20:40:07.022664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.021343    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") pod \"847b5581-d79b-483d-8843-7f56c7e99fbb\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") "
Nov 02 20:40:07.022664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.021420    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\") pod \"847b5581-d79b-483d-8843-7f56c7e99fbb\" (UID: \"847b5581-d79b-483d-8843-7f56c7e99fbb\") "
Nov 02 20:40:07.024984 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.024955    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca" pod "847b5581-d79b-483d-8843-7f56c7e99fbb" (UID: "847b5581-d79b-483d-8843-7f56c7e99fbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:40:07.028766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.028710    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs" pod "847b5581-d79b-483d-8843-7f56c7e99fbb" (UID: "847b5581-d79b-483d-8843-7f56c7e99fbb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:07.029319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.029289    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht" pod "847b5581-d79b-483d-8843-7f56c7e99fbb" (UID: "847b5581-d79b-483d-8843-7f56c7e99fbb"). InnerVolumeSpecName "kube-api-access-n4zht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:40:07.030491 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.030467    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls" pod "847b5581-d79b-483d-8843-7f56c7e99fbb" (UID: "847b5581-d79b-483d-8843-7f56c7e99fbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:07.123472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.123429    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/847b5581-d79b-483d-8843-7f56c7e99fbb-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:07.123472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.123473    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4zht\" (UniqueName: \"kubernetes.io/projected/847b5581-d79b-483d-8843-7f56c7e99fbb-kube-api-access-n4zht\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:07.123817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.123489    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:07.123817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.123503    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/847b5581-d79b-483d-8843-7f56c7e99fbb-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:07.427707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.419989    5457 generic.go:356] "Generic (PLEG): container finished" podID="847b5581-d79b-483d-8843-7f56c7e99fbb" containerID="a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e" exitCode=0
Nov 02 20:40:07.427707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.420134    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" event={"ID":"847b5581-d79b-483d-8843-7f56c7e99fbb","Type":"ContainerDied","Data":"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"}
Nov 02 20:40:07.427707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.420205    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m" event={"ID":"847b5581-d79b-483d-8843-7f56c7e99fbb","Type":"ContainerDied","Data":"a799e77a5c690d993785b10d1eb3ad1b2bcdb151ecb0c93fa7a28dabcdacd55e"}
Nov 02 20:40:07.427707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.420240    5457 scope.go:122] "RemoveContainer" containerID="a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"
Nov 02 20:40:07.427707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.420413    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"
Nov 02 20:40:07.497120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.489100    5457 scope.go:122] "RemoveContainer" containerID="a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"
Nov 02 20:40:07.497120 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:07.489558    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e\": container with ID starting with a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e not found: ID does not exist" containerID="a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"
Nov 02 20:40:07.497120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.489595    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e"} err="failed to get container status \"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e\": rpc error: code = NotFound desc = could not find container \"a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e\": container with ID starting with a4be65621a366ee89ccd3ea9ab4e9727c4033e7adad8ec7b5565cf3b518fc39e not found: ID does not exist"
Nov 02 20:40:07.582900 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.582860    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:40:07.586918 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:07.586886    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b3e20d8-6d66bb5747-hbn5m"]
Nov 02 20:40:09.200718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:09.200583    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="847b5581-d79b-483d-8843-7f56c7e99fbb" path="/var/lib/kubelet/pods/847b5581-d79b-483d-8843-7f56c7e99fbb/volumes"
Nov 02 20:40:17.371309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.371266    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:40:17.372939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.372913    5457 cpu_manager.go:414] "containerMap: removing container" podUID="847b5581-d79b-483d-8843-7f56c7e99fbb" containerName="maas-api"
Nov 02 20:40:17.373114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.373098    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="847b5581-d79b-483d-8843-7f56c7e99fbb" containerName="maas-api"
Nov 02 20:40:17.373455 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.373427    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="847b5581-d79b-483d-8843-7f56c7e99fbb" containerName="maas-api"
Nov 02 20:40:17.379199 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.379176    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.439453 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.439405    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:40:17.481734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.479988    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-df17143f-dockercfg-wnfhk\""
Nov 02 20:40:17.481734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.480085    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-df17143f\""
Nov 02 20:40:17.527646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.498285    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.527646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.525975    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfspc\" (UniqueName: \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.637020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.636902    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.637020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.637011    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfspc\" (UniqueName: \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.650765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.646398    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:17.810653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:17.801522    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfspc\" (UniqueName: \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\") pod \"payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:18.028981 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.028899    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:18.162633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.162591    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:40:18.162842 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.162813    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" podUID="184f2ed5-8be7-45ae-b980-e9882c234c9f" containerName="maas-api" containerID="cri-o://f5a0a5095ce658ad264e48715d09beb18d0bcddea4a613cb1bf500c9769e16a7" gracePeriod=30
Nov 02 20:40:18.531096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.531067    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:40:18.621154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.620596    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" event={"ID":"79819f68-de1b-400a-bb4f-b2e4323c6e87","Type":"ContainerStarted","Data":"c3a7d192bf997f1db2b756f9a3a7a7fdb9e6030e8aa2591ad6387348788551ce"}
Nov 02 20:40:18.624776 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.624725    5457 generic.go:356] "Generic (PLEG): container finished" podID="184f2ed5-8be7-45ae-b980-e9882c234c9f" containerID="f5a0a5095ce658ad264e48715d09beb18d0bcddea4a613cb1bf500c9769e16a7" exitCode=0
Nov 02 20:40:18.625164 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.625006    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" event={"ID":"184f2ed5-8be7-45ae-b980-e9882c234c9f","Type":"ContainerDied","Data":"f5a0a5095ce658ad264e48715d09beb18d0bcddea4a613cb1bf500c9769e16a7"}
Nov 02 20:40:18.629296 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.629274    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:40:18.710767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.693140    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\") pod \"184f2ed5-8be7-45ae-b980-e9882c234c9f\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") "
Nov 02 20:40:18.711224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.711193    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\" (UniqueName: \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\") pod \"184f2ed5-8be7-45ae-b980-e9882c234c9f\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") "
Nov 02 20:40:18.711513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.711495    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\") pod \"184f2ed5-8be7-45ae-b980-e9882c234c9f\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") "
Nov 02 20:40:18.711903 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.711878    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") pod \"184f2ed5-8be7-45ae-b980-e9882c234c9f\" (UID: \"184f2ed5-8be7-45ae-b980-e9882c234c9f\") "
Nov 02 20:40:18.720027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.716962    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca" pod "184f2ed5-8be7-45ae-b980-e9882c234c9f" (UID: "184f2ed5-8be7-45ae-b980-e9882c234c9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:40:18.734704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.727752    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs" pod "184f2ed5-8be7-45ae-b980-e9882c234c9f" (UID: "184f2ed5-8be7-45ae-b980-e9882c234c9f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:18.734704 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.732751    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls" pod "184f2ed5-8be7-45ae-b980-e9882c234c9f" (UID: "184f2ed5-8be7-45ae-b980-e9882c234c9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:18.761419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.751863    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw" pod "184f2ed5-8be7-45ae-b980-e9882c234c9f" (UID: "184f2ed5-8be7-45ae-b980-e9882c234c9f"). InnerVolumeSpecName "kube-api-access-qgqqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:40:18.831552 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.813920    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184f2ed5-8be7-45ae-b980-e9882c234c9f-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:18.835896 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.835867    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:18.844783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.844752    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/184f2ed5-8be7-45ae-b980-e9882c234c9f-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:18.844980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:18.844964    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqqw\" (UniqueName: \"kubernetes.io/projected/184f2ed5-8be7-45ae-b980-e9882c234c9f-kube-api-access-qgqqw\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:19.632699 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:19.632661    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"
Nov 02 20:40:19.633157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:19.632709    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6" event={"ID":"184f2ed5-8be7-45ae-b980-e9882c234c9f","Type":"ContainerDied","Data":"2e530248715dae1b4893ae50e77fb259f66c15371e07bad165031a7b46e958ce"}
Nov 02 20:40:19.633157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:19.632787    5457 scope.go:122] "RemoveContainer" containerID="f5a0a5095ce658ad264e48715d09beb18d0bcddea4a613cb1bf500c9769e16a7"
Nov 02 20:40:19.786768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:19.786731    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:40:19.832533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:19.832498    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6c66f658-76fcf67fd4-dgvc6"]
Nov 02 20:40:20.077787 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:20.077718    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:40:21.177404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.177317    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="184f2ed5-8be7-45ae-b980-e9882c234c9f" path="/var/lib/kubelet/pods/184f2ed5-8be7-45ae-b980-e9882c234c9f/volumes"
Nov 02 20:40:21.798158 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.798125    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:40:21.799186 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.799157    5457 cpu_manager.go:414] "containerMap: removing container" podUID="184f2ed5-8be7-45ae-b980-e9882c234c9f" containerName="maas-api"
Nov 02 20:40:21.799186 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.799183    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="184f2ed5-8be7-45ae-b980-e9882c234c9f" containerName="maas-api"
Nov 02 20:40:21.799376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.799293    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="184f2ed5-8be7-45ae-b980-e9882c234c9f" containerName="maas-api"
Nov 02 20:40:21.802732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.802708    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:21.854843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.852037    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-23d588ad-openshift-default-dockercfg-rxgf8\""
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:21.922751    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69s9l\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090378    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090425    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090460    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090511    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090597    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.090763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090637    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.091256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090774    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.091256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.090916    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.104744 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.103281    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:40:22.286189 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.259662    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.287286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.287259    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69s9l\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.294487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.287838    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.294751 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.288246    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.297817    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.298761    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.298816    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.298869    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.298969    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.299009    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.299144    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.301612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.299533    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.306319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.302184    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.306319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.303133    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.306319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.303681    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.306319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.304006    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.383887 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.383852    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.403732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.402641    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69s9l\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\") pod \"e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") " pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:22.443710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:22.438043    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:23.011353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.011320    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:40:23.012862 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:40:23.012832    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5059a897_a57c_4a25_9256_1b8c0b0c7253.slice/crio-ab1c7e852fa5b33a4e841e5418315c56e35fbe4b43b56bbba299c312e7079e7f WatchSource:0}: Error finding container ab1c7e852fa5b33a4e841e5418315c56e35fbe4b43b56bbba299c312e7079e7f: Status 404 returned error can't find the container with id ab1c7e852fa5b33a4e841e5418315c56e35fbe4b43b56bbba299c312e7079e7f
Nov 02 20:40:23.016678 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.016643    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:40:23.016802 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.016749    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:40:23.016865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.016801    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:40:23.667401 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.667307    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" event={"ID":"79819f68-de1b-400a-bb4f-b2e4323c6e87","Type":"ContainerStarted","Data":"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"}
Nov 02 20:40:23.667401 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.667379    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:23.669452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.669418    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerStarted","Data":"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"}
Nov 02 20:40:23.669575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.669482    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerStarted","Data":"ab1c7e852fa5b33a4e841e5418315c56e35fbe4b43b56bbba299c312e7079e7f"}
Nov 02 20:40:23.778143 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:23.778091    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" podStartSLOduration=1.918897442 podStartE2EDuration="6.778076058s" totalImagesPullingTime="4.859178616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:40:23.774903703 +0000 UTC m=+1490.713292772" watchObservedRunningTime="2026-11-02 20:40:23.778076058 +0000 UTC m=+1490.716465130"
Nov 02 20:40:23.809035 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:23.808999    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:40:24.462801 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.462767    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:24.468398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.468373    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:24.587152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.587085    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podStartSLOduration=3.587067362 podStartE2EDuration="3.587067362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:40:23.910141354 +0000 UTC m=+1490.848530472" watchObservedRunningTime="2026-11-02 20:40:24.587067362 +0000 UTC m=+1491.525456435"
Nov 02 20:40:24.674971 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.674933    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:24.675892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.675872    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:40:24.977100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.977064    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:40:24.977365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:24.977261    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" podUID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" containerName="maas-api" containerID="cri-o://914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e" gracePeriod=30
Nov 02 20:40:25.456872 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.456833    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:40:25.542323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.542275    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\") pod \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") "
Nov 02 20:40:25.542525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.542354    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\") pod \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") "
Nov 02 20:40:25.542525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.542397    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") pod \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") "
Nov 02 20:40:25.542641 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.542568    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\" (UniqueName: \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\") pod \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\" (UID: \"e6c4b185-0a7d-4e3b-9a05-f058812fa415\") "
Nov 02 20:40:25.542825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.542786    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca" pod "e6c4b185-0a7d-4e3b-9a05-f058812fa415" (UID: "e6c4b185-0a7d-4e3b-9a05-f058812fa415"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:40:25.543347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.543319    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c4b185-0a7d-4e3b-9a05-f058812fa415-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:25.544828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.544796    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs" pod "e6c4b185-0a7d-4e3b-9a05-f058812fa415" (UID: "e6c4b185-0a7d-4e3b-9a05-f058812fa415"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:25.544828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.544815    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls" pod "e6c4b185-0a7d-4e3b-9a05-f058812fa415" (UID: "e6c4b185-0a7d-4e3b-9a05-f058812fa415"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:40:25.545053 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.545032    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x" pod "e6c4b185-0a7d-4e3b-9a05-f058812fa415" (UID: "e6c4b185-0a7d-4e3b-9a05-f058812fa415"). InnerVolumeSpecName "kube-api-access-c655x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:40:25.670786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.669913    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:25.670786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.669961    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c4b185-0a7d-4e3b-9a05-f058812fa415-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:25.670786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.669976    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c655x\" (UniqueName: \"kubernetes.io/projected/e6c4b185-0a7d-4e3b-9a05-f058812fa415-kube-api-access-c655x\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:40:25.770919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.768429    5457 generic.go:356] "Generic (PLEG): container finished" podID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" containerID="914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e" exitCode=0
Nov 02 20:40:25.770919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.769514    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"
Nov 02 20:40:25.773185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.773156    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" event={"ID":"e6c4b185-0a7d-4e3b-9a05-f058812fa415","Type":"ContainerDied","Data":"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"}
Nov 02 20:40:25.773467 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.773437    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv" event={"ID":"e6c4b185-0a7d-4e3b-9a05-f058812fa415","Type":"ContainerDied","Data":"d27eaafaae743960ada7726836b674b06ac5b7dcb7109b7ca8a7cf757f6d7768"}
Nov 02 20:40:25.773706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.773678    5457 scope.go:122] "RemoveContainer" containerID="914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"
Nov 02 20:40:25.805249 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.804828    5457 scope.go:122] "RemoveContainer" containerID="914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"
Nov 02 20:40:25.805629 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:25.805523    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e\": container with ID starting with 914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e not found: ID does not exist" containerID="914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"
Nov 02 20:40:25.805629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.805568    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e"} err="failed to get container status \"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e\": rpc error: code = NotFound desc = could not find container \"914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e\": container with ID starting with 914bcd90b02ecda7d9bfdee9558608f5c058234c4d2d4975b0b542c81a8f752e not found: ID does not exist"
Nov 02 20:40:25.929670 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.929574    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:40:25.933586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:25.933560    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-574357e2-77fbf5fbd6-plxxv"]
Nov 02 20:40:27.175438 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:27.175404    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" path="/var/lib/kubelet/pods/e6c4b185-0a7d-4e3b-9a05-f058812fa415/volumes"
Nov 02 20:40:30.101557 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.101517    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:40:30.102955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.102928    5457 cpu_manager.go:414] "containerMap: removing container" podUID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" containerName="maas-api"
Nov 02 20:40:30.103100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.103085    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" containerName="maas-api"
Nov 02 20:40:30.103406 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.103390    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6c4b185-0a7d-4e3b-9a05-f058812fa415" containerName="maas-api"
Nov 02 20:40:30.120744 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.120030    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.211710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.195470    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:40:30.211710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.200956    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-23d588ad\""
Nov 02 20:40:30.211710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.201737    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-23d588ad-dockercfg-89jw5\""
Nov 02 20:40:30.211710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.208815    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.211710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.208948    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txd7z\" (UniqueName: \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.338234 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.338194    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.358273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.357923    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.401252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.358577    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txd7z\" (UniqueName: \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.483635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.471257    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:40:30.508503 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.505615    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.519478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.519432    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:40:30.520995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.520963    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txd7z\" (UniqueName: \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\") pod \"payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.625177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.625104    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.625177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.625167    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjljx\" (UniqueName: \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.726220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.726187    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.726371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.726250    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjljx\" (UniqueName: \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.726921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.726899    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.755075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.755052    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:30.783738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.783711    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjljx\" (UniqueName: \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\") pod \"payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") " pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:30.836729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:30.836426    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:31.128042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.128011    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:40:31.128563 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:40:31.128536    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ad85b7_1468_463a_8e18_c4552b9b0e73.slice/crio-b26909254b9d4a8c2b2328ef066c4de97de1b727eebd33f465110b26cf4f3a1c WatchSource:0}: Error finding container b26909254b9d4a8c2b2328ef066c4de97de1b727eebd33f465110b26cf4f3a1c: Status 404 returned error can't find the container with id b26909254b9d4a8c2b2328ef066c4de97de1b727eebd33f465110b26cf4f3a1c
Nov 02 20:40:31.232833 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.232812    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:40:31.234745 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:40:31.234717    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e93b15_5f2f_4319_afbb_600d8b6e7d9c.slice/crio-19736cad5d1edb6e35351d203b592203ca01f99396f7be5bc1b879da0ab8b9c3 WatchSource:0}: Error finding container 19736cad5d1edb6e35351d203b592203ca01f99396f7be5bc1b879da0ab8b9c3: Status 404 returned error can't find the container with id 19736cad5d1edb6e35351d203b592203ca01f99396f7be5bc1b879da0ab8b9c3
Nov 02 20:40:31.859831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.859789    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" event={"ID":"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c","Type":"ContainerStarted","Data":"6a030e511a62a0b723b7b07d781bc431cfb37b92fc153a8747d3cf43daca8279"}
Nov 02 20:40:31.860030 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.859859    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" event={"ID":"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c","Type":"ContainerStarted","Data":"19736cad5d1edb6e35351d203b592203ca01f99396f7be5bc1b879da0ab8b9c3"}
Nov 02 20:40:31.860030 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.859983    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:31.861526 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.861496    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" event={"ID":"47ad85b7-1468-463a-8e18-c4552b9b0e73","Type":"ContainerStarted","Data":"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"}
Nov 02 20:40:31.862157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.861543    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" event={"ID":"47ad85b7-1468-463a-8e18-c4552b9b0e73","Type":"ContainerStarted","Data":"b26909254b9d4a8c2b2328ef066c4de97de1b727eebd33f465110b26cf4f3a1c"}
Nov 02 20:40:31.862157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.861578    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:31.969936 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:31.969870    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" podStartSLOduration=1.9698510489999999 podStartE2EDuration="1.969851049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:40:31.967529761 +0000 UTC m=+1498.905918829" watchObservedRunningTime="2026-11-02 20:40:31.969851049 +0000 UTC m=+1498.908240127"
Nov 02 20:40:32.076187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:32.076136    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" podStartSLOduration=2.076122125 podStartE2EDuration="2.076122125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:40:32.07513304 +0000 UTC m=+1499.013522111" watchObservedRunningTime="2026-11-02 20:40:32.076122125 +0000 UTC m=+1499.014511193"
Nov 02 20:40:33.378237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:33.378209    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:40:33.378667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:33.378502    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:40:34.678082 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:34.678052    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:40:42.870291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:42.870263    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:40:42.870681 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:42.870331    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:40:52.974367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:52.974331    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:40:53.809160 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:53.809121    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:40:56.272448 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.272415    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:40:56.278653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.278631    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.327299 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.327268    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-df17143f-serving-cert\""
Nov 02 20:40:56.378358 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.378328    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:40:56.430165 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.430133    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.430343 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.430185    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.430419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.430352    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744jt\" (UniqueName: \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.430478 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.430413    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.548837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.548747    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.564709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.560796    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.567460 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.567422    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744jt\" (UniqueName: \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.567775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.567748    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.574992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.568889    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.575186 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:56.549187    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-serving-cert: secret "maas-api-e2e-ait-df17143f-serving-cert" not found
Nov 02 20:40:56.575662 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:40:56.575641    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls podName:5d4e4b47-ff5b-42b8-b780-367d60417d5f nodeName:}" failed. No retries permitted until 2026-11-02 20:40:57.075611566 +0000 UTC m=+1524.014000613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls") pod "maas-api-e2e-ait-df17143f-7bc4bff855-7582c" (UID: "5d4e4b47-ff5b-42b8-b780-367d60417d5f") : secret "maas-api-e2e-ait-df17143f-serving-cert" not found
Nov 02 20:40:56.582707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.580177    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:56.635616 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:56.633977    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-744jt\" (UniqueName: \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:57.085789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:57.085752    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:57.088366 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:57.088341    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") pod \"maas-api-e2e-ait-df17143f-7bc4bff855-7582c\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:57.192315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:57.192280    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:57.568276 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:57.568243    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:40:57.570446 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:40:57.570415    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4e4b47_ff5b_42b8_b780_367d60417d5f.slice/crio-b69a557b153711f6f0bf25f5b056045827f607b03baae783caab373f27f03d26 WatchSource:0}: Error finding container b69a557b153711f6f0bf25f5b056045827f607b03baae783caab373f27f03d26: Status 404 returned error can't find the container with id b69a557b153711f6f0bf25f5b056045827f607b03baae783caab373f27f03d26
Nov 02 20:40:58.019142 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:58.019108    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" event={"ID":"5d4e4b47-ff5b-42b8-b780-367d60417d5f","Type":"ContainerStarted","Data":"b69a557b153711f6f0bf25f5b056045827f607b03baae783caab373f27f03d26"}
Nov 02 20:40:59.026333 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:59.026247    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" event={"ID":"5d4e4b47-ff5b-42b8-b780-367d60417d5f","Type":"ContainerStarted","Data":"20e4a105d0e23341756f40777e606c121e9ba8217955ce48d8f9ddc131354e9a"}
Nov 02 20:40:59.026786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:59.026410    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:40:59.137092 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:40:59.137040    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" podStartSLOduration=2.03538352 podStartE2EDuration="3.137024408s" totalImagesPullingTime="1.101640888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:40:59.134853931 +0000 UTC m=+1526.073243035" watchObservedRunningTime="2026-11-02 20:40:59.137024408 +0000 UTC m=+1526.075413476"
Nov 02 20:41:05.038672 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:05.038637    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:41:10.475580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.475542    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:41:10.481727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.481700    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.530435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.530401    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bb3d8f2f-openshift-default-dockercfg-k8nvv\""
Nov 02 20:41:10.584251 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.584217    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:41:10.593553 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.593519    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.593752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.593713    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.593845 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.593813    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.593903 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.593864    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.594057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.594037    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4lt\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.594144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.594096    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.594203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.594173    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.594257 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.594245    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.594338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.594321    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698081    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698161    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698253    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698338    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698365    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698490    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4lt\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698545    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698572    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.698775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.698632    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.720065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.699182    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.720065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.710156    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.720065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.710845    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.720065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.711105    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.720065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.711371    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.732515 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.732435    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.746132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.746098    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.843935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.843903    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:10.882757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:10.861090    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4lt\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\") pod \"e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") " pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:11.096128 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:11.096034    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:11.556711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:11.547502    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:41:11.593897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:11.593833    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:11.593986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:11.593919    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:11.593986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:11.593964    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:12.118778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:12.118735    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerStarted","Data":"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"}
Nov 02 20:41:12.118924 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:12.118809    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerStarted","Data":"459f4540eadb49c48183686586de6123817e9be1dccd228ba745534dc4b62576"}
Nov 02 20:41:12.234314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:12.234258    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podStartSLOduration=2.234244717 podStartE2EDuration="2.234244717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:41:12.230960894 +0000 UTC m=+1539.169349964" watchObservedRunningTime="2026-11-02 20:41:12.234244717 +0000 UTC m=+1539.172633863"
Nov 02 20:41:13.097144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:13.097109    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:13.102632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:13.102603    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:13.125063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:13.125032    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:13.126048 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:13.126022    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:41:20.671674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.671459    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:41:20.676498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.676464    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.731452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.724303    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-strvv\" (UniqueName: \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.731452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.724470    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.766157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.766094    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:41:20.769801 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.769750    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bb3d8f2f\""
Nov 02 20:41:20.792031 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.791344    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bb3d8f2f-dockercfg-lhjh5\""
Nov 02 20:41:20.852708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.827855    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-strvv\" (UniqueName: \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.858558 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.857143    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.858558 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.858419    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:20.965753 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:20.964710    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-strvv\" (UniqueName: \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\") pod \"payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") " pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:21.081867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:21.081835    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:21.457360 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:21.457326    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:41:21.459366 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:41:21.459336    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d5841b_8236_4931_9df6_423f5ddd3283.slice/crio-d0c3c469f0e350a744396c9e336c05050057d68c6230c0c35ef713f8ffeb7d54 WatchSource:0}: Error finding container d0c3c469f0e350a744396c9e336c05050057d68c6230c0c35ef713f8ffeb7d54: Status 404 returned error can't find the container with id d0c3c469f0e350a744396c9e336c05050057d68c6230c0c35ef713f8ffeb7d54
Nov 02 20:41:22.217781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:22.217739    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" event={"ID":"84d5841b-8236-4931-9df6-423f5ddd3283","Type":"ContainerStarted","Data":"fc58f4153666bf1d261958d1083efbad12cd10fdda006c96fe1ba4f0091c47a5"}
Nov 02 20:41:22.218188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:22.217824    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" event={"ID":"84d5841b-8236-4931-9df6-423f5ddd3283","Type":"ContainerStarted","Data":"d0c3c469f0e350a744396c9e336c05050057d68c6230c0c35ef713f8ffeb7d54"}
Nov 02 20:41:22.218188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:22.217848    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:22.328521 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:22.328462    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" podStartSLOduration=2.328448422 podStartE2EDuration="2.328448422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:41:22.325087126 +0000 UTC m=+1549.263476196" watchObservedRunningTime="2026-11-02 20:41:22.328448422 +0000 UTC m=+1549.266837490"
Nov 02 20:41:23.809849 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:41:23.809809    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:41:33.433986 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.433950    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:41:33.461463 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.457155    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:41:33.509939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.471410    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.524817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.524782    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.525301 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.525276    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbsg\" (UniqueName: \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.539253 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.539215    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:41:33.562014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.561980    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-654ae4\""
Nov 02 20:41:33.562399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.562382    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-654ae4-dockercfg-v4ppp\""
Nov 02 20:41:33.647728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.647281    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:41:33.656030 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.655993    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.662238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.662204    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbsg\" (UniqueName: \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.663068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.663041    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.664526 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.664278    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:33.816188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.765719    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzlf\" (UniqueName: \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.816188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.765784    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.858708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.808590    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:41:33.907956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.881305    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzlf\" (UniqueName: \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.970629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.970592    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.994151 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.971753    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:33.999624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:33.999555    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbsg\" (UniqueName: \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\") pod \"payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:34.014502 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:34.014461    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzlf\" (UniqueName: \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\") pod \"payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:34.080969 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:34.080903    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:34.256427 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:34.256391    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:34.452288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:34.452266    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:41:34.453996 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:41:34.453966    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785d56fe_d51f_4b76_8f06_c524928f1340.slice/crio-99f399993ea7705f8fc54768c86f77c026df646dbfd1a26076d26d1f6ba61463 WatchSource:0}: Error finding container 99f399993ea7705f8fc54768c86f77c026df646dbfd1a26076d26d1f6ba61463: Status 404 returned error can't find the container with id 99f399993ea7705f8fc54768c86f77c026df646dbfd1a26076d26d1f6ba61463
Nov 02 20:41:34.634756 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:34.634126    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:41:34.640502 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:41:34.640468    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439eee24_7a80_4e98_b41b_ac41dfb9209e.slice/crio-9b84edea6c0c370a168f082ae4a7d34b41c3a56bbeb9add05893a077dfcf76ca WatchSource:0}: Error finding container 9b84edea6c0c370a168f082ae4a7d34b41c3a56bbeb9add05893a077dfcf76ca: Status 404 returned error can't find the container with id 9b84edea6c0c370a168f082ae4a7d34b41c3a56bbeb9add05893a077dfcf76ca
Nov 02 20:41:35.442649 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.442608    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" event={"ID":"439eee24-7a80-4e98-b41b-ac41dfb9209e","Type":"ContainerStarted","Data":"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"}
Nov 02 20:41:35.442877 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.442674    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" event={"ID":"439eee24-7a80-4e98-b41b-ac41dfb9209e","Type":"ContainerStarted","Data":"9b84edea6c0c370a168f082ae4a7d34b41c3a56bbeb9add05893a077dfcf76ca"}
Nov 02 20:41:35.442877 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.442740    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:35.444357 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.444322    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" event={"ID":"785d56fe-d51f-4b76-8f06-c524928f1340","Type":"ContainerStarted","Data":"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"}
Nov 02 20:41:35.444490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.444370    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" event={"ID":"785d56fe-d51f-4b76-8f06-c524928f1340","Type":"ContainerStarted","Data":"99f399993ea7705f8fc54768c86f77c026df646dbfd1a26076d26d1f6ba61463"}
Nov 02 20:41:35.444490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.444398    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:35.597944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.597880    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" podStartSLOduration=2.597865461 podStartE2EDuration="2.597865461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:41:35.549926707 +0000 UTC m=+1562.488315776" watchObservedRunningTime="2026-11-02 20:41:35.597865461 +0000 UTC m=+1562.536254530"
Nov 02 20:41:35.677162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:35.659374    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" podStartSLOduration=2.6593575510000003 podStartE2EDuration="2.659357551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:41:35.65823033 +0000 UTC m=+1562.596619399" watchObservedRunningTime="2026-11-02 20:41:35.659357551 +0000 UTC m=+1562.597746620"
Nov 02 20:41:43.627354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:43.627313    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:41:46.487549 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:46.487512    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:41:46.516710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:46.499885    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:41:53.809768 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:41:53.809720    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:41:55.377482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.376871    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": read tcp 10.134.0.2:36456->10.134.0.73:15021: read: connection reset by peer" start-of-body=
Nov 02 20:41:55.377482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.376943    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": read tcp 10.134.0.2:36456->10.134.0.73:15021: read: connection reset by peer"
Nov 02 20:41:55.662979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.662948    5457 generic.go:356] "Generic (PLEG): container finished" podID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerID="8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83" exitCode=0
Nov 02 20:41:55.663150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.663006    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerDied","Data":"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"}
Nov 02 20:41:55.663415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.663399    5457 scope.go:122] "RemoveContainer" containerID="8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"
Nov 02 20:41:55.664964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.664935    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:55.665051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.665009    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:55.665051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:55.665042    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:41:56.671349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:56.671314    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerStarted","Data":"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"}
Nov 02 20:41:57.462623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:57.462583    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:41:57.462878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:57.462853    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 20:41:57.462958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:57.462915    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 20:41:58.462642 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:58.462596    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 20:41:58.463067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:58.462657    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 20:41:59.462912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:59.462879    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 20:41:59.463398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:41:59.462959    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 20:42:00.462737 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:00.462674    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 20:42:00.462919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:00.462758    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 20:42:01.464210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:01.464153    5457 patch_prober.go:29] interesting pod/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 20:42:01.512892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:01.512844    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 20:42:02.466333 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:02.466298    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:42:02.466793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:02.466621    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:42:02.467404 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:02.467384    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:42:08.653213 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.653174    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:42:08.660227 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.660203    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.709012 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.708975    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:42:08.744175 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.744137    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.744363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.744195    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.744363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.744299    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhsl\" (UniqueName: \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.744550 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.744529    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.753306 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.753279    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bb3d8f2f-serving-cert\""
Nov 02 20:42:08.845957 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.845918    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.846152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.846022    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.846152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.846055    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.846152 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.846092    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhsl\" (UniqueName: \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.846324 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:08.846189    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-serving-cert: secret "maas-api-e2e-mt-bb3d8f2f-serving-cert" not found
Nov 02 20:42:08.846324 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:08.846287    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls podName:360c9b31-6e96-4f5c-aa62-e4cb2343b1af nodeName:}" failed. No retries permitted until 2026-11-02 20:42:09.34626328 +0000 UTC m=+1596.284652345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls") pod "maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" (UID: "360c9b31-6e96-4f5c-aa62-e4cb2343b1af") : secret "maas-api-e2e-mt-bb3d8f2f-serving-cert" not found
Nov 02 20:42:08.846722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.846666    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.848452 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.848426    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:08.943972 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:08.943876    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhsl\" (UniqueName: \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:09.362225 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:09.362136    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:09.364666 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:09.364640    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") pod \"maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:09.573380 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:09.573343    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:09.944499 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:09.944469    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:42:09.946061 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:42:09.946022    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360c9b31_6e96_4f5c_aa62_e4cb2343b1af.slice/crio-2f1ab56261c1276ebc98a7b87bb4d59a46281ced991516e250b698354633e23f WatchSource:0}: Error finding container 2f1ab56261c1276ebc98a7b87bb4d59a46281ced991516e250b698354633e23f: Status 404 returned error can't find the container with id 2f1ab56261c1276ebc98a7b87bb4d59a46281ced991516e250b698354633e23f
Nov 02 20:42:10.836243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:10.836214    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" event={"ID":"360c9b31-6e96-4f5c-aa62-e4cb2343b1af","Type":"ContainerStarted","Data":"2f1ab56261c1276ebc98a7b87bb4d59a46281ced991516e250b698354633e23f"}
Nov 02 20:42:11.844378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:11.844337    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" event={"ID":"360c9b31-6e96-4f5c-aa62-e4cb2343b1af","Type":"ContainerStarted","Data":"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"}
Nov 02 20:42:11.844800 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:11.844473    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:11.972991 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:11.972939    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" podStartSLOduration=3.0864421 podStartE2EDuration="3.972925437s" totalImagesPullingTime="886.483337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:42:11.969874324 +0000 UTC m=+1598.908263431" watchObservedRunningTime="2026-11-02 20:42:11.972925437 +0000 UTC m=+1598.911314547"
Nov 02 20:42:13.630436 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:13.629442    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:42:17.916723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:17.887910    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:42:17.999713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:17.997605    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:42:18.032575 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.031589    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.138614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.106858    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:42:18.200718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.114315    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w0-0ea576-dockercfg-g7zfp\""
Nov 02 20:42:18.200718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.135327    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w0-0ea576\""
Nov 02 20:42:18.376613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.376574    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxl97\" (UniqueName: \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.384316 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.384283    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.487759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.485645    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxl97\" (UniqueName: \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.487759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.485928    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.495716 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.492797    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.545110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.545074    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxl97\" (UniqueName: \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\") pod \"payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.630523 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.630445    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" podUID="79819f68-de1b-400a-bb4f-b2e4323c6e87" containerName="payload-pre-processing" containerID="cri-o://f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1" gracePeriod=25
Nov 02 20:42:18.683200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.683169    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:18.915222 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.915195    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:42:18.963613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.963575    5457 generic.go:356] "Generic (PLEG): container finished" podID="79819f68-de1b-400a-bb4f-b2e4323c6e87" containerID="f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1" exitCode=0
Nov 02 20:42:18.964123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.963662    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"
Nov 02 20:42:18.964123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.963661    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" event={"ID":"79819f68-de1b-400a-bb4f-b2e4323c6e87","Type":"ContainerDied","Data":"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"}
Nov 02 20:42:18.964123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.963755    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb" event={"ID":"79819f68-de1b-400a-bb4f-b2e4323c6e87","Type":"ContainerDied","Data":"c3a7d192bf997f1db2b756f9a3a7a7fdb9e6030e8aa2591ad6387348788551ce"}
Nov 02 20:42:18.964123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.963788    5457 scope.go:122] "RemoveContainer" containerID="f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"
Nov 02 20:42:18.973281 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.973260    5457 scope.go:122] "RemoveContainer" containerID="f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"
Nov 02 20:42:18.973594 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:18.973571    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1\": container with ID starting with f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1 not found: ID does not exist" containerID="f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"
Nov 02 20:42:18.973706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.973602    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1"} err="failed to get container status \"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1\": rpc error: code = NotFound desc = could not find container \"f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1\": container with ID starting with f8b9c5b5403b0f5115c94d6029b40cbf21d1a5243832168cac1e8604bd6f0db1 not found: ID does not exist"
Nov 02 20:42:18.993407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.993351    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\") pod \"79819f68-de1b-400a-bb4f-b2e4323c6e87\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") "
Nov 02 20:42:18.993516 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.993436    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\" (UniqueName: \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\") pod \"79819f68-de1b-400a-bb4f-b2e4323c6e87\" (UID: \"79819f68-de1b-400a-bb4f-b2e4323c6e87\") "
Nov 02 20:42:18.993722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.993701    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume" pod "79819f68-de1b-400a-bb4f-b2e4323c6e87" (UID: "79819f68-de1b-400a-bb4f-b2e4323c6e87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:42:18.994068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.994035    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79819f68-de1b-400a-bb4f-b2e4323c6e87-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:18.995605 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:18.995581    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc" pod "79819f68-de1b-400a-bb4f-b2e4323c6e87" (UID: "79819f68-de1b-400a-bb4f-b2e4323c6e87"). InnerVolumeSpecName "kube-api-access-nfspc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:42:19.057017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.056988    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:42:19.058241 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:42:19.058212    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35203a54_49cb_4b14_af60_c6d45223aee2.slice/crio-3eae244e6fa42738e37e519dfcaccbf2351a3cee000d21562a0ba01c2746af03 WatchSource:0}: Error finding container 3eae244e6fa42738e37e519dfcaccbf2351a3cee000d21562a0ba01c2746af03: Status 404 returned error can't find the container with id 3eae244e6fa42738e37e519dfcaccbf2351a3cee000d21562a0ba01c2746af03
Nov 02 20:42:19.095574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.095550    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfspc\" (UniqueName: \"kubernetes.io/projected/79819f68-de1b-400a-bb4f-b2e4323c6e87-kube-api-access-nfspc\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:19.371374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.371285    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:42:19.375288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.375258    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df17143f-757c897c75-zh6nb"]
Nov 02 20:42:19.972872 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.972841    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" event={"ID":"35203a54-49cb-4b14-af60-c6d45223aee2","Type":"ContainerStarted","Data":"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"}
Nov 02 20:42:19.973265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.972889    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" event={"ID":"35203a54-49cb-4b14-af60-c6d45223aee2","Type":"ContainerStarted","Data":"3eae244e6fa42738e37e519dfcaccbf2351a3cee000d21562a0ba01c2746af03"}
Nov 02 20:42:19.973265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:19.973022    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:20.121707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:20.105024    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" podStartSLOduration=3.10500417 podStartE2EDuration="3.10500417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:42:20.085955134 +0000 UTC m=+1607.024344205" watchObservedRunningTime="2026-11-02 20:42:20.10500417 +0000 UTC m=+1607.043393240"
Nov 02 20:42:21.174950 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:21.174919    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79819f68-de1b-400a-bb4f-b2e4323c6e87" path="/var/lib/kubelet/pods/79819f68-de1b-400a-bb4f-b2e4323c6e87/volumes"
Nov 02 20:42:23.808431 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:23.808395    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:42:30.983396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:30.983368    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:42:32.032572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:32.032534    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:42:32.159528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:32.159493    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:42:35.680079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:35.680042    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:42:37.033246 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.033182    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" podUID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" containerName="payload-processing" containerID="cri-o://6a030e511a62a0b723b7b07d781bc431cfb37b92fc153a8747d3cf43daca8279" gracePeriod=25
Nov 02 20:42:37.160839 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.160791    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" podUID="47ad85b7-1468-463a-8e18-c4552b9b0e73" containerName="payload-pre-processing" containerID="cri-o://fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e" gracePeriod=25
Nov 02 20:42:37.184362 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.184330    5457 generic.go:356] "Generic (PLEG): container finished" podID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" containerID="6a030e511a62a0b723b7b07d781bc431cfb37b92fc153a8747d3cf43daca8279" exitCode=0
Nov 02 20:42:37.184482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.184398    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" event={"ID":"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c","Type":"ContainerDied","Data":"6a030e511a62a0b723b7b07d781bc431cfb37b92fc153a8747d3cf43daca8279"}
Nov 02 20:42:37.350588 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.350558    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:42:37.410597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.410175    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\" (UniqueName: \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\") pod \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") "
Nov 02 20:42:37.410597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.410445    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\") pod \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\" (UID: \"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c\") "
Nov 02 20:42:37.411093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.411062    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume" pod "c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" (UID: "c3e93b15-5f2f-4319-afbb-600d8b6e7d9c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:42:37.416722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.413612    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx" pod "c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" (UID: "c3e93b15-5f2f-4319-afbb-600d8b6e7d9c"). InnerVolumeSpecName "kube-api-access-qjljx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:42:37.462132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.462110    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:42:37.512032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.511994    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\") pod \"47ad85b7-1468-463a-8e18-c4552b9b0e73\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") "
Nov 02 20:42:37.512215 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.512155    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\" (UniqueName: \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\") pod \"47ad85b7-1468-463a-8e18-c4552b9b0e73\" (UID: \"47ad85b7-1468-463a-8e18-c4552b9b0e73\") "
Nov 02 20:42:37.512413 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.512390    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume" pod "47ad85b7-1468-463a-8e18-c4552b9b0e73" (UID: "47ad85b7-1468-463a-8e18-c4552b9b0e73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:42:37.512768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.512740    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:37.512768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.512768    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ad85b7-1468-463a-8e18-c4552b9b0e73-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:37.512953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.512782    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjljx\" (UniqueName: \"kubernetes.io/projected/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c-kube-api-access-qjljx\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:37.514407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.514383    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z" pod "47ad85b7-1468-463a-8e18-c4552b9b0e73" (UID: "47ad85b7-1468-463a-8e18-c4552b9b0e73"). InnerVolumeSpecName "kube-api-access-txd7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:42:37.614109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:37.614019    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txd7z\" (UniqueName: \"kubernetes.io/projected/47ad85b7-1468-463a-8e18-c4552b9b0e73-kube-api-access-txd7z\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:38.218565 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.218525    5457 generic.go:356] "Generic (PLEG): container finished" podID="47ad85b7-1468-463a-8e18-c4552b9b0e73" containerID="fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e" exitCode=0
Nov 02 20:42:38.219236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.218783    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"
Nov 02 20:42:38.219365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.218834    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" event={"ID":"47ad85b7-1468-463a-8e18-c4552b9b0e73","Type":"ContainerDied","Data":"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"}
Nov 02 20:42:38.219505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.219405    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p" event={"ID":"47ad85b7-1468-463a-8e18-c4552b9b0e73","Type":"ContainerDied","Data":"b26909254b9d4a8c2b2328ef066c4de97de1b727eebd33f465110b26cf4f3a1c"}
Nov 02 20:42:38.219505 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.219447    5457 scope.go:122] "RemoveContainer" containerID="fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"
Nov 02 20:42:38.224027 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.223997    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4" event={"ID":"c3e93b15-5f2f-4319-afbb-600d8b6e7d9c","Type":"ContainerDied","Data":"19736cad5d1edb6e35351d203b592203ca01f99396f7be5bc1b879da0ab8b9c3"}
Nov 02 20:42:38.224146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.224110    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"
Nov 02 20:42:38.235081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.235064    5457 scope.go:122] "RemoveContainer" containerID="fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"
Nov 02 20:42:38.235363 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:38.235343    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e\": container with ID starting with fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e not found: ID does not exist" containerID="fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"
Nov 02 20:42:38.235410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.235373    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e"} err="failed to get container status \"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e\": rpc error: code = NotFound desc = could not find container \"fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e\": container with ID starting with fbab32e105cad332b6e23f581f4cd299d24acac89c608839352d59c079624d0e not found: ID does not exist"
Nov 02 20:42:38.235410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.235390    5457 scope.go:122] "RemoveContainer" containerID="6a030e511a62a0b723b7b07d781bc431cfb37b92fc153a8747d3cf43daca8279"
Nov 02 20:42:38.374202 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.374108    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:42:38.436870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.436836    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-23d588ad-855d8c7fb7-cpj2p"]
Nov 02 20:42:38.483424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.483394    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:42:38.486953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:38.486914    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-23d588ad-576c54dd96-8pfj4"]
Nov 02 20:42:39.174363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:39.174329    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47ad85b7-1468-463a-8e18-c4552b9b0e73" path="/var/lib/kubelet/pods/47ad85b7-1468-463a-8e18-c4552b9b0e73/volumes"
Nov 02 20:42:39.174800 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:39.174786    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" path="/var/lib/kubelet/pods/c3e93b15-5f2f-4319-afbb-600d8b6e7d9c/volumes"
Nov 02 20:42:47.292373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.292333    5457 generic.go:356] "Generic (PLEG): container finished" podID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerID="b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996" exitCode=0
Nov 02 20:42:47.292822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.292400    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerDied","Data":"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"}
Nov 02 20:42:47.292867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.292833    5457 scope.go:122] "RemoveContainer" containerID="b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"
Nov 02 20:42:47.294369 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.294336    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:42:47.294482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.294424    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:42:47.294545 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:47.294511    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:42:48.300148 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:48.300111    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerStarted","Data":"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"}
Nov 02 20:42:48.937954 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:48.937918    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:42:48.938195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:48.938168    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" podUID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" containerName="maas-api" containerID="cri-o://20e4a105d0e23341756f40777e606c121e9ba8217955ce48d8f9ddc131354e9a" gracePeriod=30
Nov 02 20:42:49.102528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.102076    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:42:49.102528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.102210    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:49.102528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.102267    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:49.668763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.626140    5457 generic.go:356] "Generic (PLEG): container finished" podID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" containerID="20e4a105d0e23341756f40777e606c121e9ba8217955ce48d8f9ddc131354e9a" exitCode=0
Nov 02 20:42:49.668763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.658027    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" event={"ID":"5d4e4b47-ff5b-42b8-b780-367d60417d5f","Type":"ContainerDied","Data":"20e4a105d0e23341756f40777e606c121e9ba8217955ce48d8f9ddc131354e9a"}
Nov 02 20:42:49.840935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.840902    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:42:49.957754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.952977    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\") pod \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") "
Nov 02 20:42:49.957754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.953229    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\") pod \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") "
Nov 02 20:42:49.957754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.953351    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\" (UniqueName: \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\") pod \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") "
Nov 02 20:42:49.957754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.953438    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") pod \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\" (UID: \"5d4e4b47-ff5b-42b8-b780-367d60417d5f\") "
Nov 02 20:42:49.957754 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.954453    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca" pod "5d4e4b47-ff5b-42b8-b780-367d60417d5f" (UID: "5d4e4b47-ff5b-42b8-b780-367d60417d5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:42:49.971180 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.966950    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt" pod "5d4e4b47-ff5b-42b8-b780-367d60417d5f" (UID: "5d4e4b47-ff5b-42b8-b780-367d60417d5f"). InnerVolumeSpecName "kube-api-access-744jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:42:49.978474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:49.977887    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls" pod "5d4e4b47-ff5b-42b8-b780-367d60417d5f" (UID: "5d4e4b47-ff5b-42b8-b780-367d60417d5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:42:50.066710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.063154    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-744jt\" (UniqueName: \"kubernetes.io/projected/5d4e4b47-ff5b-42b8-b780-367d60417d5f-kube-api-access-744jt\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:50.066710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.063209    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:50.066710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.063225    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e4b47-ff5b-42b8-b780-367d60417d5f-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:50.066710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.066191    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs" pod "5d4e4b47-ff5b-42b8-b780-367d60417d5f" (UID: "5d4e4b47-ff5b-42b8-b780-367d60417d5f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:42:50.101126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.100645    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:50.101126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.100773    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:50.223395 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.223311    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d4e4b47-ff5b-42b8-b780-367d60417d5f-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:42:50.634435 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.634401    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"
Nov 02 20:42:50.634595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.634434    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c" event={"ID":"5d4e4b47-ff5b-42b8-b780-367d60417d5f","Type":"ContainerDied","Data":"b69a557b153711f6f0bf25f5b056045827f607b03baae783caab373f27f03d26"}
Nov 02 20:42:50.634595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.634503    5457 scope.go:122] "RemoveContainer" containerID="20e4a105d0e23341756f40777e606c121e9ba8217955ce48d8f9ddc131354e9a"
Nov 02 20:42:50.813785 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.813748    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:42:50.818852 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:50.818819    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df17143f-7bc4bff855-7582c"]
Nov 02 20:42:51.120893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:51.115508    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:51.120893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:51.115574    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:51.266448 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:51.266416    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" path="/var/lib/kubelet/pods/5d4e4b47-ff5b-42b8-b780-367d60417d5f/volumes"
Nov 02 20:42:52.111711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:52.110678    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:52.111711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:52.110819    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:53.103184 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:53.103147    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:53.103475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:53.103443    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:53.834568 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:42:53.834533    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:42:54.111766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:54.111266    5457 patch_prober.go:29] interesting pod/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 02 20:42:54.111766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:54.111337    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 02 20:42:55.101604 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:55.101574    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:42:55.102102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:55.101989    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:42:55.102758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:42:55.102738    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:43:03.632870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:03.616152    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:43:03.632870 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:03.616447    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy" containerID="cri-o://0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f" gracePeriod=30
Nov 02 20:43:08.411711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.407549    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:43:08.411711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.407856    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy" containerID="cri-o://fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db" gracePeriod=30
Nov 02 20:43:08.888871 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.888843    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:43:08.940020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.939989    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940110    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940139    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940262    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:08.940433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940296    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940342    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940387    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:08.940433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940403    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940513    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940565    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940569    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:08.940664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940581    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:08.940664 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940592    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\") pod \"5059a897-a57c-4a25-9256-1b8c0b0c7253\" (UID: \"5059a897-a57c-4a25-9256-1b8c0b0c7253\") "
Nov 02 20:43:08.940964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.940859    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:43:08.941235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.941212    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5059a897-a57c-4a25-9256-1b8c0b0c7253-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:08.941235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.941234    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:08.941379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.941248    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:08.941379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.941262    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:08.941379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.941273    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:08.942771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.942748    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "kube-api-access-69s9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:08.942771 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.942763    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:08.942908 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.942852    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:43:08.942908 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.942862    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token" pod "5059a897-a57c-4a25-9256-1b8c0b0c7253" (UID: "5059a897-a57c-4a25-9256-1b8c0b0c7253"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:08.976239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.976204    5457 generic.go:356] "Generic (PLEG): container finished" podID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerID="0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f" exitCode=0
Nov 02 20:43:08.976373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.976244    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerDied","Data":"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"}
Nov 02 20:43:08.976373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.976255    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"
Nov 02 20:43:08.976373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.976289    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd" event={"ID":"5059a897-a57c-4a25-9256-1b8c0b0c7253","Type":"ContainerDied","Data":"ab1c7e852fa5b33a4e841e5418315c56e35fbe4b43b56bbba299c312e7079e7f"}
Nov 02 20:43:08.976373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.976313    5457 scope.go:122] "RemoveContainer" containerID="0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"
Nov 02 20:43:08.987247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.987228    5457 scope.go:122] "RemoveContainer" containerID="8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"
Nov 02 20:43:08.996145 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.996125    5457 scope.go:122] "RemoveContainer" containerID="0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"
Nov 02 20:43:08.996390 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:08.996368    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f\": container with ID starting with 0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f not found: ID does not exist" containerID="0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"
Nov 02 20:43:08.996457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.996397    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f"} err="failed to get container status \"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f\": rpc error: code = NotFound desc = could not find container \"0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f\": container with ID starting with 0d614bcf61b275f180056b1869d46b66636f71f43dadf94482f737201100f05f not found: ID does not exist"
Nov 02 20:43:08.996457 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.996413    5457 scope.go:122] "RemoveContainer" containerID="8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"
Nov 02 20:43:08.996656 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:08.996639    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83\": container with ID starting with 8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83 not found: ID does not exist" containerID="8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"
Nov 02 20:43:08.996718 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:08.996661    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83"} err="failed to get container status \"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83\": rpc error: code = NotFound desc = could not find container \"8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83\": container with ID starting with 8d0fe9867801ab2d3f2d281a832daf0f609a577bda037e2c3c31dfd4319bee83 not found: ID does not exist"
Nov 02 20:43:09.043290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.043253    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:09.043449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.043292    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69s9l\" (UniqueName: \"kubernetes.io/projected/5059a897-a57c-4a25-9256-1b8c0b0c7253-kube-api-access-69s9l\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:09.043449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.043312    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:09.043449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.043325    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5059a897-a57c-4a25-9256-1b8c0b0c7253-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:09.108172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.108136    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:43:09.113922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.113896    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-23d588ad-openshift-default-57d8459b79-jprjd"]
Nov 02 20:43:09.174662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:09.174632    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" path="/var/lib/kubelet/pods/5059a897-a57c-4a25-9256-1b8c0b0c7253/volumes"
Nov 02 20:43:13.684843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.684540    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:43:13.763079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763051    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763092    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763218    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763276    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763394 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763315    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763394 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763369    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763393    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:13.763498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763408    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:13.763498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763483    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.763650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763537    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.764098 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763815    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\") pod \"85a12728-56b0-4278-a34b-9e9fae947fad\" (UID: \"85a12728-56b0-4278-a34b-9e9fae947fad\") "
Nov 02 20:43:13.764098 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.763842    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:13.764098 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764029    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:13.764321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764201    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:43:13.764633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764543    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.764633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764569    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a12728-56b0-4278-a34b-9e9fae947fad-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.764633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764583    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.764633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764596    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.764633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.764611    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.766804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.766769    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:43:13.766892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.766815    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "kube-api-access-b84k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:13.766892 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.766844    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:13.766992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.766958    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy" pod "85a12728-56b0-4278-a34b-9e9fae947fad" (UID: "85a12728-56b0-4278-a34b-9e9fae947fad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:13.866868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.866831    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.866868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.866869    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a12728-56b0-4278-a34b-9e9fae947fad-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.867116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.866883    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a12728-56b0-4278-a34b-9e9fae947fad-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:13.867116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:13.866896    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b84k9\" (UniqueName: \"kubernetes.io/projected/85a12728-56b0-4278-a34b-9e9fae947fad-kube-api-access-b84k9\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:14.254893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.254856    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:43:14.256966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.255370    5457 generic.go:356] "Generic (PLEG): container finished" podID="85a12728-56b0-4278-a34b-9e9fae947fad" containerID="fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db" exitCode=0
Nov 02 20:43:14.256966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.255562    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"
Nov 02 20:43:14.257161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257027    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.257161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257048    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.257261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257170    5457 cpu_manager.go:414] "containerMap: removing container" podUID="47ad85b7-1468-463a-8e18-c4552b9b0e73" containerName="payload-pre-processing"
Nov 02 20:43:14.257261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257183    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47ad85b7-1468-463a-8e18-c4552b9b0e73" containerName="payload-pre-processing"
Nov 02 20:43:14.257261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257209    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.257261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257239    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.257446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257338    5457 cpu_manager.go:414] "containerMap: removing container" podUID="79819f68-de1b-400a-bb4f-b2e4323c6e87" containerName="payload-pre-processing"
Nov 02 20:43:14.257446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257349    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79819f68-de1b-400a-bb4f-b2e4323c6e87" containerName="payload-pre-processing"
Nov 02 20:43:14.257446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257421    5457 cpu_manager.go:414] "containerMap: removing container" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy"
Nov 02 20:43:14.257446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257429    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy"
Nov 02 20:43:14.257655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257440    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" containerName="maas-api"
Nov 02 20:43:14.257655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257558    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" containerName="maas-api"
Nov 02 20:43:14.257655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257583    5457 cpu_manager.go:414] "containerMap: removing container" podUID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" containerName="payload-processing"
Nov 02 20:43:14.257655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.257592    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" containerName="payload-processing"
Nov 02 20:43:14.258456 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258433    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" containerName="istio-proxy"
Nov 02 20:43:14.258544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258474    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3e93b15-5f2f-4319-afbb-600d8b6e7d9c" containerName="payload-processing"
Nov 02 20:43:14.258544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258493    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="79819f68-de1b-400a-bb4f-b2e4323c6e87" containerName="payload-pre-processing"
Nov 02 20:43:14.258544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258514    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.258544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258527    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d4e4b47-ff5b-42b8-b780-367d60417d5f" containerName="maas-api"
Nov 02 20:43:14.258785 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258548    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="47ad85b7-1468-463a-8e18-c4552b9b0e73" containerName="payload-pre-processing"
Nov 02 20:43:14.258785 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.258608    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5059a897-a57c-4a25-9256-1b8c0b0c7253" containerName="istio-proxy"
Nov 02 20:43:14.276177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.273490    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:43:14.276177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.273556    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" event={"ID":"85a12728-56b0-4278-a34b-9e9fae947fad","Type":"ContainerDied","Data":"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"}
Nov 02 20:43:14.276177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.273592    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd" event={"ID":"85a12728-56b0-4278-a34b-9e9fae947fad","Type":"ContainerDied","Data":"73f3acb1d25846b6f1efc20973311dd94d982de01401f5501d796ef69df8a236"}
Nov 02 20:43:14.276177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.273621    5457 scope.go:122] "RemoveContainer" containerID="fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"
Nov 02 20:43:14.276177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.273838    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.280350 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.280319    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:43:14.300715 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.288975    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.369751 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.367964    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-4166b0\""
Nov 02 20:43:14.369751 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.368164    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-4166b0-dockercfg-ljb4c\""
Nov 02 20:43:14.401861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.392200    5457 scope.go:122] "RemoveContainer" containerID="fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"
Nov 02 20:43:14.401861 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:14.400534    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db\": container with ID starting with fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db not found: ID does not exist" containerID="fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"
Nov 02 20:43:14.401861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.400757    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db"} err="failed to get container status \"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db\": rpc error: code = NotFound desc = could not find container \"fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db\": container with ID starting with fed4845e9b813753ed47fd6598c8415f92f7f6d8ad6dd63a859971a255f012db not found: ID does not exist"
Nov 02 20:43:14.496706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.495605    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.496706 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.495773    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.529759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.508823    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:43:14.529759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.508903    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8jv\" (UniqueName: \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.529759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.508997    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzrm\" (UniqueName: \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.606255 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.606220    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:43:14.619150 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.619113    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.619422 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.619288    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8jv\" (UniqueName: \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.619525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.619464    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzrm\" (UniqueName: \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.619657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.619641    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.620543 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.620517    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.627286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.627258    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.645810 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.645783    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:43:14.651485 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.651463    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-kkwfd"]
Nov 02 20:43:14.681805 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.681779    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzrm\" (UniqueName: \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\") pod \"payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:14.681912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.681783    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8jv\" (UniqueName: \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\") pod \"payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.907668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.907643    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:14.910814 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:14.910790    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:15.178040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:15.177960    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85a12728-56b0-4278-a34b-9e9fae947fad" path="/var/lib/kubelet/pods/85a12728-56b0-4278-a34b-9e9fae947fad/volumes"
Nov 02 20:43:15.286743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:15.286713    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:43:15.292104 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:43:15.292075    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0c64c1_4bd1_435c_b7d5_7ca9c914539a.slice/crio-559a2eb6187306395d77d60d29808dae624442608089d278dee5a17ff6d10e2e WatchSource:0}: Error finding container 559a2eb6187306395d77d60d29808dae624442608089d278dee5a17ff6d10e2e: Status 404 returned error can't find the container with id 559a2eb6187306395d77d60d29808dae624442608089d278dee5a17ff6d10e2e
Nov 02 20:43:15.336383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:15.335432    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:43:15.336383 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:43:15.335653    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d7246d_3782_485b_b062_8e762d4f5667.slice/crio-fcdb7b6fde4153c8bcf3d768e795d9eb5d5adf7e4c2bfd8a2adddf4572be8c67 WatchSource:0}: Error finding container fcdb7b6fde4153c8bcf3d768e795d9eb5d5adf7e4c2bfd8a2adddf4572be8c67: Status 404 returned error can't find the container with id fcdb7b6fde4153c8bcf3d768e795d9eb5d5adf7e4c2bfd8a2adddf4572be8c67
Nov 02 20:43:16.270855 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.270819    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" event={"ID":"27d7246d-3782-485b-b062-8e762d4f5667","Type":"ContainerStarted","Data":"b1d808ad8fbebf1eff345551051dc9300eaa8c28d1981a34188e8a6204ff6eb1"}
Nov 02 20:43:16.271322 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.270873    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" event={"ID":"27d7246d-3782-485b-b062-8e762d4f5667","Type":"ContainerStarted","Data":"fcdb7b6fde4153c8bcf3d768e795d9eb5d5adf7e4c2bfd8a2adddf4572be8c67"}
Nov 02 20:43:16.271322 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.271031    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:16.272927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.272897    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" event={"ID":"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a","Type":"ContainerStarted","Data":"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"}
Nov 02 20:43:16.273058 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.272946    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" event={"ID":"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a","Type":"ContainerStarted","Data":"559a2eb6187306395d77d60d29808dae624442608089d278dee5a17ff6d10e2e"}
Nov 02 20:43:16.273058 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.272978    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:16.381418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.381367    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" podStartSLOduration=2.381351265 podStartE2EDuration="2.381351265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:43:16.379968773 +0000 UTC m=+1663.318357841" watchObservedRunningTime="2026-11-02 20:43:16.381351265 +0000 UTC m=+1663.319740351"
Nov 02 20:43:16.510712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:16.490570    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" podStartSLOduration=2.49054927 podStartE2EDuration="2.49054927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:43:16.486965684 +0000 UTC m=+1663.425354755" watchObservedRunningTime="2026-11-02 20:43:16.49054927 +0000 UTC m=+1663.428938341"
Nov 02 20:43:22.718411 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:22.718375    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:43:24.005535 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:24.005457    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:43:27.310944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.310226    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:43:27.328055 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.328026    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:43:27.329025 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.328986    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.351537 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.351509    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:43:27.351668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.351577    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:43:27.351668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.351599    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:43:27.357041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.357017    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:43:27.357151 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.357110    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.412007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.411970    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrqqn\" (UniqueName: \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.412192 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.412106    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.412240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.412203    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdhnp\" (UniqueName: \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.412351 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.412331    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.424125 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.424102    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w6-1620dc-dockercfg-xdg8z\""
Nov 02 20:43:27.424263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.424158    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w6-1620dc\""
Nov 02 20:43:27.514200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.514162    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrqqn\" (UniqueName: \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.514376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.514208    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.514376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.514257    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdhnp\" (UniqueName: \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.514376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.514322    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.515040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.515013    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.515154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.515079    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.572089 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.572015    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrqqn\" (UniqueName: \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\") pod \"payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.584114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.584089    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdhnp\" (UniqueName: \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\") pod \"payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:27.660674 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.660635    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:27.671563 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:27.671537    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:28.063353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.063324    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:43:28.064191 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:43:28.064154    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf378953d_0d2a_4a0d_a5b3_a025589084b6.slice/crio-b43fa5ee7e57e81e28586909b8882702d6c11a26545d92a6154ccfd7a16a18c9 WatchSource:0}: Error finding container b43fa5ee7e57e81e28586909b8882702d6c11a26545d92a6154ccfd7a16a18c9: Status 404 returned error can't find the container with id b43fa5ee7e57e81e28586909b8882702d6c11a26545d92a6154ccfd7a16a18c9
Nov 02 20:43:28.111945 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.110789    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:43:28.113448 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:43:28.113424    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c8c1a9_92cc_44df_9303_9ef20ee69d28.slice/crio-b5c2c15705404295f3edb158fddc4bec284d9aaaa447308554842f1e669a994a WatchSource:0}: Error finding container b5c2c15705404295f3edb158fddc4bec284d9aaaa447308554842f1e669a994a: Status 404 returned error can't find the container with id b5c2c15705404295f3edb158fddc4bec284d9aaaa447308554842f1e669a994a
Nov 02 20:43:28.403624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.403589    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" event={"ID":"f378953d-0d2a-4a0d-a5b3-a025589084b6","Type":"ContainerStarted","Data":"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"}
Nov 02 20:43:28.404067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.403645    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" event={"ID":"f378953d-0d2a-4a0d-a5b3-a025589084b6","Type":"ContainerStarted","Data":"b43fa5ee7e57e81e28586909b8882702d6c11a26545d92a6154ccfd7a16a18c9"}
Nov 02 20:43:28.404067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.403675    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:28.405217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.405190    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" event={"ID":"41c8c1a9-92cc-44df-9303-9ef20ee69d28","Type":"ContainerStarted","Data":"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"}
Nov 02 20:43:28.405314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.405233    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" event={"ID":"41c8c1a9-92cc-44df-9303-9ef20ee69d28","Type":"ContainerStarted","Data":"b5c2c15705404295f3edb158fddc4bec284d9aaaa447308554842f1e669a994a"}
Nov 02 20:43:28.405314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.405252    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:28.513205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.513150    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" podStartSLOduration=1.5131332579999999 podStartE2EDuration="1.513133258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:43:28.511154905 +0000 UTC m=+1675.449543973" watchObservedRunningTime="2026-11-02 20:43:28.513133258 +0000 UTC m=+1675.451522326"
Nov 02 20:43:28.620623 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:28.620569    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" podStartSLOduration=2.620555402 podStartE2EDuration="2.620555402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:43:28.618328223 +0000 UTC m=+1675.556717292" watchObservedRunningTime="2026-11-02 20:43:28.620555402 +0000 UTC m=+1675.558944469"
Nov 02 20:43:29.634409 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:29.634364    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main" containerID="cri-o://23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc" gracePeriod=45
Nov 02 20:43:29.913975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:29.913887    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:43:30.079760 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.079731    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.079948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.079788    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.079948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.079886    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.080070 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.079989    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:30.080126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080072    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:30.080126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080091    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.080228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080127    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\" (UniqueName: \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.080228 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080149    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\") pod \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\" (UID: \"e9e7d7b6-93d8-4b61-a887-9fca549a7eda\") "
Nov 02 20:43:30.080559 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080534    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:30.080803 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080769    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.080894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080810    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.080894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.080826    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.083793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.083000    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:43:30.083793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.083004    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "kube-api-access-mkr5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:30.084156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.084131    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm" pod "e9e7d7b6-93d8-4b61-a887-9fca549a7eda" (UID: "e9e7d7b6-93d8-4b61-a887-9fca549a7eda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:43:30.182349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.182270    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.182349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.182305    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.182349 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.182318    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkr5l\" (UniqueName: \"kubernetes.io/projected/e9e7d7b6-93d8-4b61-a887-9fca549a7eda-kube-api-access-mkr5l\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:30.420070 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.420035    5457 generic.go:356] "Generic (PLEG): container finished" podID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerID="23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc" exitCode=0
Nov 02 20:43:30.420259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.420083    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"
Nov 02 20:43:30.420259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.420113    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" event={"ID":"e9e7d7b6-93d8-4b61-a887-9fca549a7eda","Type":"ContainerDied","Data":"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"}
Nov 02 20:43:30.420259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.420167    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4" event={"ID":"e9e7d7b6-93d8-4b61-a887-9fca549a7eda","Type":"ContainerDied","Data":"fb27b74ec7caf0fa47973ce0fe715aa83b5f8b110d1adf5b2ac2bd6ca199b77f"}
Nov 02 20:43:30.420259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.420192    5457 scope.go:122] "RemoveContainer" containerID="23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"
Nov 02 20:43:30.433233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.432829    5457 scope.go:122] "RemoveContainer" containerID="23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"
Nov 02 20:43:30.433233 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:30.433194    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc\": container with ID starting with 23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc not found: ID does not exist" containerID="23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"
Nov 02 20:43:30.433390 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.433234    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc"} err="failed to get container status \"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc\": rpc error: code = NotFound desc = could not find container \"23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc\": container with ID starting with 23a521e1677f644d1479ec5df37580ca081db4d6d229ddc2b1392c4d2493c8cc not found: ID does not exist"
Nov 02 20:43:30.584141 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.584107    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:43:30.587415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:30.587387    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-694cee/premium-w2-694cee-kserve-68b8878c58-p8rn4"]
Nov 02 20:43:31.174332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:31.174295    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" path="/var/lib/kubelet/pods/e9e7d7b6-93d8-4b61-a887-9fca549a7eda/volumes"
Nov 02 20:43:37.310243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:37.310204    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:43:39.414585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:39.414557    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:43:39.415038 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:39.414619    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:43:42.310960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.310905    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" podUID="84d5841b-8236-4931-9df6-423f5ddd3283" containerName="payload-processing" containerID="cri-o://fc58f4153666bf1d261958d1083efbad12cd10fdda006c96fe1ba4f0091c47a5" gracePeriod=25
Nov 02 20:43:42.505591 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.505554    5457 generic.go:356] "Generic (PLEG): container finished" podID="84d5841b-8236-4931-9df6-423f5ddd3283" containerID="fc58f4153666bf1d261958d1083efbad12cd10fdda006c96fe1ba4f0091c47a5" exitCode=0
Nov 02 20:43:42.505765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.505627    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" event={"ID":"84d5841b-8236-4931-9df6-423f5ddd3283","Type":"ContainerDied","Data":"fc58f4153666bf1d261958d1083efbad12cd10fdda006c96fe1ba4f0091c47a5"}
Nov 02 20:43:42.585919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.585858    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:43:42.705595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.705566    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\" (UniqueName: \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\") pod \"84d5841b-8236-4931-9df6-423f5ddd3283\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") "
Nov 02 20:43:42.705830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.705813    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\") pod \"84d5841b-8236-4931-9df6-423f5ddd3283\" (UID: \"84d5841b-8236-4931-9df6-423f5ddd3283\") "
Nov 02 20:43:42.706168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.706142    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume" pod "84d5841b-8236-4931-9df6-423f5ddd3283" (UID: "84d5841b-8236-4931-9df6-423f5ddd3283"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:43:42.706365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.706347    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84d5841b-8236-4931-9df6-423f5ddd3283-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:42.707757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.707727    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv" pod "84d5841b-8236-4931-9df6-423f5ddd3283" (UID: "84d5841b-8236-4931-9df6-423f5ddd3283"). InnerVolumeSpecName "kube-api-access-strvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:43:42.807668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:42.807625    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-strvv\" (UniqueName: \"kubernetes.io/projected/84d5841b-8236-4931-9df6-423f5ddd3283-kube-api-access-strvv\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:43:43.522735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:43.522640    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"
Nov 02 20:43:43.522735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:43.522672    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf" event={"ID":"84d5841b-8236-4931-9df6-423f5ddd3283","Type":"ContainerDied","Data":"d0c3c469f0e350a744396c9e336c05050057d68c6230c0c35ef713f8ffeb7d54"}
Nov 02 20:43:43.523227 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:43.522793    5457 scope.go:122] "RemoveContainer" containerID="fc58f4153666bf1d261958d1083efbad12cd10fdda006c96fe1ba4f0091c47a5"
Nov 02 20:43:43.678462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:43.678436    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:43:43.724572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:43.724529    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bb3d8f2f-6d655c9cc8-xvtnf"]
Nov 02 20:43:45.174822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:43:45.174791    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84d5841b-8236-4931-9df6-423f5ddd3283" path="/var/lib/kubelet/pods/84d5841b-8236-4931-9df6-423f5ddd3283/volumes"
Nov 02 20:43:53.808390 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:43:53.808354    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:44:00.782733 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:00.782640    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:44:07.275899 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.275863    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:44:07.276415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.276074    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" podUID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" containerName="maas-api" containerID="cri-o://f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9" gracePeriod=30
Nov 02 20:44:07.662635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.662592    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.764776    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") pod \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") "
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.764856    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\" (UniqueName: \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\") pod \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") "
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.764923    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\") pod \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") "
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.765048    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\") pod \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\" (UID: \"360c9b31-6e96-4f5c-aa62-e4cb2343b1af\") "
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.776925    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca" pod "360c9b31-6e96-4f5c-aa62-e4cb2343b1af" (UID: "360c9b31-6e96-4f5c-aa62-e4cb2343b1af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.779232    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls" pod "360c9b31-6e96-4f5c-aa62-e4cb2343b1af" (UID: "360c9b31-6e96-4f5c-aa62-e4cb2343b1af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:44:07.781745 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.779619    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs" pod "360c9b31-6e96-4f5c-aa62-e4cb2343b1af" (UID: "360c9b31-6e96-4f5c-aa62-e4cb2343b1af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:44:07.807539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.807482    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl" pod "360c9b31-6e96-4f5c-aa62-e4cb2343b1af" (UID: "360c9b31-6e96-4f5c-aa62-e4cb2343b1af"). InnerVolumeSpecName "kube-api-access-hmhsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:07.906717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.903909    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:07.906717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.903952    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:07.906717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.903966    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:07.906717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.903980    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmhsl\" (UniqueName: \"kubernetes.io/projected/360c9b31-6e96-4f5c-aa62-e4cb2343b1af-kube-api-access-hmhsl\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:07.919217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.919048    5457 generic.go:356] "Generic (PLEG): container finished" podID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" containerID="f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9" exitCode=0
Nov 02 20:44:07.919217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.919106    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" event={"ID":"360c9b31-6e96-4f5c-aa62-e4cb2343b1af","Type":"ContainerDied","Data":"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"}
Nov 02 20:44:07.919217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.919145    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr" event={"ID":"360c9b31-6e96-4f5c-aa62-e4cb2343b1af","Type":"ContainerDied","Data":"2f1ab56261c1276ebc98a7b87bb4d59a46281ced991516e250b698354633e23f"}
Nov 02 20:44:07.919217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.919167    5457 scope.go:122] "RemoveContainer" containerID="f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"
Nov 02 20:44:07.919472 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.919300    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"
Nov 02 20:44:07.936621 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.936601    5457 scope.go:122] "RemoveContainer" containerID="f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"
Nov 02 20:44:07.936932 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:07.936912    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9\": container with ID starting with f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9 not found: ID does not exist" containerID="f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"
Nov 02 20:44:07.936995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:07.936940    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9"} err="failed to get container status \"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9\": rpc error: code = NotFound desc = could not find container \"f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9\": container with ID starting with f7cb2cf347b722c8fabbcb18c8a62c85c17fd92a81d735377f31bbbfe06b56d9 not found: ID does not exist"
Nov 02 20:44:08.077650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.077614    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:44:08.080365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.080344    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3d8f2f-6d4d47b76c-ssdtr"]
Nov 02 20:44:08.662578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.662543    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:44:08.663044 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.662800    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy" containerID="cri-o://1f3ebff834d7ee3c6c6c9b012cacb266f56c9bbdf791a40fb7caf4a867a8b795" gracePeriod=30
Nov 02 20:44:08.708968 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.708934    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:44:08.709170 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:08.709150    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy" containerID="cri-o://93de0b2f870c5262edc39ed1c1ca19ecc39c76791f97a2fc183182e249b71f6f" gracePeriod=30
Nov 02 20:44:09.175223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:09.175187    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" path="/var/lib/kubelet/pods/360c9b31-6e96-4f5c-aa62-e4cb2343b1af/volumes"
Nov 02 20:44:13.970083 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.968533    5457 generic.go:356] "Generic (PLEG): container finished" podID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerID="93de0b2f870c5262edc39ed1c1ca19ecc39c76791f97a2fc183182e249b71f6f" exitCode=0
Nov 02 20:44:13.970083 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.968578    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" event={"ID":"0d19441a-6597-4b81-ba45-38cee8ba5e46","Type":"ContainerDied","Data":"93de0b2f870c5262edc39ed1c1ca19ecc39c76791f97a2fc183182e249b71f6f"}
Nov 02 20:44:13.970724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.970246    5457 generic.go:356] "Generic (PLEG): container finished" podID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerID="1f3ebff834d7ee3c6c6c9b012cacb266f56c9bbdf791a40fb7caf4a867a8b795" exitCode=0
Nov 02 20:44:13.970724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.970273    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" event={"ID":"21b2ea50-acc0-4361-8388-8c9b13f4c832","Type":"ContainerDied","Data":"1f3ebff834d7ee3c6c6c9b012cacb266f56c9bbdf791a40fb7caf4a867a8b795"}
Nov 02 20:44:13.970724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.970317    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl" event={"ID":"21b2ea50-acc0-4361-8388-8c9b13f4c832","Type":"ContainerDied","Data":"1923a419feed13ccc9dab8aba7fdb242690228cc7726c59b21a7e3876fd8b47a"}
Nov 02 20:44:13.970724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.970345    5457 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1923a419feed13ccc9dab8aba7fdb242690228cc7726c59b21a7e3876fd8b47a"
Nov 02 20:44:13.998539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:13.998489    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:44:14.039132 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.039107    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:44:14.096931 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.096906    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.096971    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097009    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097038    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097107    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097163    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097231    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097271    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097325    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.097389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097362    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097441    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097498    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097552    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097606    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097604    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.097777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097681    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097765    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097800    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.097990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097854    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.097990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097871    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\") pod \"0d19441a-6597-4b81-ba45-38cee8ba5e46\" (UID: \"0d19441a-6597-4b81-ba45-38cee8ba5e46\") "
Nov 02 20:44:14.097990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097884    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.097990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.097913    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\") pod \"21b2ea50-acc0-4361-8388-8c9b13f4c832\" (UID: \"21b2ea50-acc0-4361-8388-8c9b13f4c832\") "
Nov 02 20:44:14.098256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098011    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.098256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098039    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.098256 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098239    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.098428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098257    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:14.098428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098377    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098649    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098679    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098723    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098737    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098751    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098765    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098778    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d19441a-6597-4b81-ba45-38cee8ba5e46-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098792    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098805    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b2ea50-acc0-4361-8388-8c9b13f4c832-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.098897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.098870    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.099835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.099809    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "kube-api-access-hbq54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:14.100107 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100079    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:14.100319 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100292    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:14.100441 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100419    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:44:14.100580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100559    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "kube-api-access-plswz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:14.100647 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100597    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.100647 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.100621    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy" pod "0d19441a-6597-4b81-ba45-38cee8ba5e46" (UID: "0d19441a-6597-4b81-ba45-38cee8ba5e46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:14.101244 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.101222    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo" pod "21b2ea50-acc0-4361-8388-8c9b13f4c832" (UID: "21b2ea50-acc0-4361-8388-8c9b13f4c832"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:44:14.201117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201084    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plswz\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-kube-api-access-plswz\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201117    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201117 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201132    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201147    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbq54\" (UniqueName: \"kubernetes.io/projected/21b2ea50-acc0-4361-8388-8c9b13f4c832-kube-api-access-hbq54\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201162    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201177    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201189    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201203    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d19441a-6597-4b81-ba45-38cee8ba5e46-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.201419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.201215    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b2ea50-acc0-4361-8388-8c9b13f4c832-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:14.985758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:14.985360    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"
Nov 02 20:44:15.006767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.001882    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"
Nov 02 20:44:15.006767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.005965    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf" event={"ID":"0d19441a-6597-4b81-ba45-38cee8ba5e46","Type":"ContainerDied","Data":"4504f5da377ea4c9161ef9b817e10f03e19129c47cd894762770369efdca54e2"}
Nov 02 20:44:15.006767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.006034    5457 scope.go:122] "RemoveContainer" containerID="93de0b2f870c5262edc39ed1c1ca19ecc39c76791f97a2fc183182e249b71f6f"
Nov 02 20:44:15.209131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.209098    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:44:15.255468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.255394    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-kxgcl"]
Nov 02 20:44:15.315469 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.315430    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:44:15.320945 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:15.320922    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-6d2kf"]
Nov 02 20:44:17.180496 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:17.180465    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" path="/var/lib/kubelet/pods/0d19441a-6597-4b81-ba45-38cee8ba5e46/volumes"
Nov 02 20:44:17.180948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:17.180932    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" path="/var/lib/kubelet/pods/21b2ea50-acc0-4361-8388-8c9b13f4c832/volumes"
Nov 02 20:44:23.811887 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:23.811840    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:44:28.320259 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:28.320222    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:44:28.320861 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:28.320493    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy" containerID="cri-o://b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f" gracePeriod=30
Nov 02 20:44:33.859707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:33.852121    5457 scope.go:122] "RemoveContainer" containerID="1f3ebff834d7ee3c6c6c9b012cacb266f56c9bbdf791a40fb7caf4a867a8b795"
Nov 02 20:44:33.979777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:33.979754    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:44:34.118403 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.118319    5457 generic.go:356] "Generic (PLEG): container finished" podID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerID="b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f" exitCode=0
Nov 02 20:44:34.118642 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.118620    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerDied","Data":"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"}
Nov 02 20:44:34.119046 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.119025    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k" event={"ID":"3bd48371-9039-42ca-af86-994c44d9ffe4","Type":"ContainerDied","Data":"459f4540eadb49c48183686586de6123817e9be1dccd228ba745534dc4b62576"}
Nov 02 20:44:34.119165 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.119153    5457 scope.go:122] "RemoveContainer" containerID="b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"
Nov 02 20:44:34.119389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.119375    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"
Nov 02 20:44:34.135139 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135113    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135272    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135301    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135320    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135368    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135402    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135425    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135460    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.135656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.135497    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\") pod \"3bd48371-9039-42ca-af86-994c44d9ffe4\" (UID: \"3bd48371-9039-42ca-af86-994c44d9ffe4\") "
Nov 02 20:44:34.136855 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.136787    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:34.136966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.136857    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:34.136966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.136919    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:34.137079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.136966    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:34.137305 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.137274    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:34.138939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.138907    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:44:34.139067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.139050    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:34.139405 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.139382    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "kube-api-access-5k4lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:34.139724 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.139663    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token" pod "3bd48371-9039-42ca-af86-994c44d9ffe4" (UID: "3bd48371-9039-42ca-af86-994c44d9ffe4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:34.154584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.154227    5457 scope.go:122] "RemoveContainer" containerID="b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"
Nov 02 20:44:34.185747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.185726    5457 scope.go:122] "RemoveContainer" containerID="b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"
Nov 02 20:44:34.185987 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:34.185959    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f\": container with ID starting with b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f not found: ID does not exist" containerID="b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"
Nov 02 20:44:34.186066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.186001    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f"} err="failed to get container status \"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f\": rpc error: code = NotFound desc = could not find container \"b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f\": container with ID starting with b75860adf90d70a7b880cdbbe3aad0ddfc3d756d330e653354a0788eee3d448f not found: ID does not exist"
Nov 02 20:44:34.186066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.186027    5457 scope.go:122] "RemoveContainer" containerID="b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"
Nov 02 20:44:34.186338 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:34.186320    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996\": container with ID starting with b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996 not found: ID does not exist" containerID="b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"
Nov 02 20:44:34.186426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.186349    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996"} err="failed to get container status \"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996\": rpc error: code = NotFound desc = could not find container \"b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996\": container with ID starting with b28600f5a102b5a07fdc46d6b6998e1c3c61d096291fed884c2d9b7b867e3996 not found: ID does not exist"
Nov 02 20:44:34.239927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239893    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.239927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239922    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239937    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239949    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239957    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239966    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239974    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bd48371-9039-42ca-af86-994c44d9ffe4-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239982    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4lt\" (UniqueName: \"kubernetes.io/projected/3bd48371-9039-42ca-af86-994c44d9ffe4-kube-api-access-5k4lt\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.240174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.239991    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bd48371-9039-42ca-af86-994c44d9ffe4-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:34.533383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.533347    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:44:34.539311 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:34.539279    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bb3d8f2f-openshift-default-5b45784ffc-64z5k"]
Nov 02 20:44:35.139334 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:35.139304    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:44:35.174675 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:35.174643    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" path="/var/lib/kubelet/pods/3bd48371-9039-42ca-af86-994c44d9ffe4/volumes"
Nov 02 20:44:44.390289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.390254    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:44:44.390799 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.390474    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" podUID="7d673905-1dee-488d-acf3-b9376b4d3a13" containerName="maas-api" containerID="cri-o://226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2" gracePeriod=30
Nov 02 20:44:44.769220 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.769187    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:44:44.947728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.943267    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\" (UniqueName: \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\") pod \"7d673905-1dee-488d-acf3-b9376b4d3a13\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") "
Nov 02 20:44:44.947728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.943350    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\") pod \"7d673905-1dee-488d-acf3-b9376b4d3a13\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") "
Nov 02 20:44:44.947728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.943440    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") pod \"7d673905-1dee-488d-acf3-b9376b4d3a13\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") "
Nov 02 20:44:44.947728 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.943547    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\") pod \"7d673905-1dee-488d-acf3-b9376b4d3a13\" (UID: \"7d673905-1dee-488d-acf3-b9376b4d3a13\") "
Nov 02 20:44:44.952716 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.950031    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca" pod "7d673905-1dee-488d-acf3-b9376b4d3a13" (UID: "7d673905-1dee-488d-acf3-b9376b4d3a13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:44.961705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.959640    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf" pod "7d673905-1dee-488d-acf3-b9376b4d3a13" (UID: "7d673905-1dee-488d-acf3-b9376b4d3a13"). InnerVolumeSpecName "kube-api-access-8lhtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:44.993488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.965884    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs" pod "7d673905-1dee-488d-acf3-b9376b4d3a13" (UID: "7d673905-1dee-488d-acf3-b9376b4d3a13"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:44:44.993488 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:44.970944    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls" pod "7d673905-1dee-488d-acf3-b9376b4d3a13" (UID: "7d673905-1dee-488d-acf3-b9376b4d3a13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:44:45.046108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.046072    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lhtf\" (UniqueName: \"kubernetes.io/projected/7d673905-1dee-488d-acf3-b9376b4d3a13-kube-api-access-8lhtf\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:45.046108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.046103    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:45.046108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.046112    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d673905-1dee-488d-acf3-b9376b4d3a13-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:45.046338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.046121    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d673905-1dee-488d-acf3-b9376b4d3a13-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:45.215947 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.215913    5457 generic.go:356] "Generic (PLEG): container finished" podID="7d673905-1dee-488d-acf3-b9376b4d3a13" containerID="226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2" exitCode=0
Nov 02 20:44:45.216102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.215959    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"
Nov 02 20:44:45.216102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.215964    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" event={"ID":"7d673905-1dee-488d-acf3-b9376b4d3a13","Type":"ContainerDied","Data":"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"}
Nov 02 20:44:45.216102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.216015    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2" event={"ID":"7d673905-1dee-488d-acf3-b9376b4d3a13","Type":"ContainerDied","Data":"b7017a74e5984cbff307eba90331737109f52736d09244c81ce31f8af78af4e2"}
Nov 02 20:44:45.216102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.216068    5457 scope.go:122] "RemoveContainer" containerID="226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"
Nov 02 20:44:45.225303 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.225283    5457 scope.go:122] "RemoveContainer" containerID="226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"
Nov 02 20:44:45.225582 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:45.225541    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2\": container with ID starting with 226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2 not found: ID does not exist" containerID="226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"
Nov 02 20:44:45.225652 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.225592    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2"} err="failed to get container status \"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2\": rpc error: code = NotFound desc = could not find container \"226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2\": container with ID starting with 226dfa90ac8500d01e603ece1327d2426fee18ae4f5bf7a14266610d8a13f1a2 not found: ID does not exist"
Nov 02 20:44:45.370263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.370191    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:44:45.374267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:45.374240    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-694cee-7755c46d89-2h6b2"]
Nov 02 20:44:47.174935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:47.174897    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d673905-1dee-488d-acf3-b9376b4d3a13" path="/var/lib/kubelet/pods/7d673905-1dee-488d-acf3-b9376b4d3a13/volumes"
Nov 02 20:44:50.160578 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.160540    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main" containerID="cri-o://d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d" gracePeriod=45
Nov 02 20:44:50.433962 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.433932    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:44:50.520162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520131    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520188    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\" (UniqueName: \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520241    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520291    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520308    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520352    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\" (UniqueName: \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\") pod \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\" (UID: \"992dfb78-ad4b-465a-99ae-8f514b02ab1a\") "
Nov 02 20:44:50.520629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520545    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:50.520629 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520615    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:50.520763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.520634    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:50.521113 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.521087    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:50.521243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.521115    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:50.521243 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.521131    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:50.522538 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.522507    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "kube-api-access-lwwjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:50.522654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.522575    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:44:50.522654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.522613    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm" pod "992dfb78-ad4b-465a-99ae-8f514b02ab1a" (UID: "992dfb78-ad4b-465a-99ae-8f514b02ab1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:50.622338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.622304    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992dfb78-ad4b-465a-99ae-8f514b02ab1a-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:50.622338 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.622344    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwwjf\" (UniqueName: \"kubernetes.io/projected/992dfb78-ad4b-465a-99ae-8f514b02ab1a-kube-api-access-lwwjf\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:50.622536 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:50.622355    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992dfb78-ad4b-465a-99ae-8f514b02ab1a-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:51.257402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.257370    5457 generic.go:356] "Generic (PLEG): container finished" podID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerID="d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d" exitCode=0
Nov 02 20:44:51.257902 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.257422    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"
Nov 02 20:44:51.257902 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.257448    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" event={"ID":"992dfb78-ad4b-465a-99ae-8f514b02ab1a","Type":"ContainerDied","Data":"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"}
Nov 02 20:44:51.257902 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.257524    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc" event={"ID":"992dfb78-ad4b-465a-99ae-8f514b02ab1a","Type":"ContainerDied","Data":"df891f7d176c7538cc6aa31d2870bcf3c36ff42f9a8d4ab9cbd186ea341de8d9"}
Nov 02 20:44:51.257902 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.257547    5457 scope.go:122] "RemoveContainer" containerID="d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"
Nov 02 20:44:51.270274 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.270250    5457 scope.go:122] "RemoveContainer" containerID="d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"
Nov 02 20:44:51.270615 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:51.270581    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d\": container with ID starting with d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d not found: ID does not exist" containerID="d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"
Nov 02 20:44:51.270783 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.270617    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d"} err="failed to get container status \"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d\": rpc error: code = NotFound desc = could not find container \"d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d\": container with ID starting with d1eed4684ebf8451e737635cbe8bc6a2872c396dee34f816e4af3ad15b5da21d not found: ID does not exist"
Nov 02 20:44:51.410252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.410218    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:44:51.456188 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:51.456113    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-c49693/simulator-w5-c49693-kserve-6c694b7b68-mwkhc"]
Nov 02 20:44:53.175547 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:53.175515    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" path="/var/lib/kubelet/pods/992dfb78-ad4b-465a-99ae-8f514b02ab1a/volumes"
Nov 02 20:44:53.809062 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:44:53.809020    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:44:54.135909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:54.135874    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:44:54.136141 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:54.136113    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy" containerID="cri-o://e9816881c7c1b3b3cf680625bc60a1dda6c0dae3ab00fa8c2cf5e3921667cc66" gracePeriod=30
Nov 02 20:44:54.154574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:54.154533    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:44:54.154843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:54.154811    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy" containerID="cri-o://a8d206d741c4642fba9ae934fa07d018ca8e209150935ea66837c8ae88e94cd0" gracePeriod=30
Nov 02 20:44:59.393709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.389272    5457 generic.go:356] "Generic (PLEG): container finished" podID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerID="a8d206d741c4642fba9ae934fa07d018ca8e209150935ea66837c8ae88e94cd0" exitCode=0
Nov 02 20:44:59.393709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.389408    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" event={"ID":"a36b88af-e35a-4f37-832e-d8ce49ecd03d","Type":"ContainerDied","Data":"a8d206d741c4642fba9ae934fa07d018ca8e209150935ea66837c8ae88e94cd0"}
Nov 02 20:44:59.393709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.391045    5457 generic.go:356] "Generic (PLEG): container finished" podID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerID="e9816881c7c1b3b3cf680625bc60a1dda6c0dae3ab00fa8c2cf5e3921667cc66" exitCode=0
Nov 02 20:44:59.393709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.391073    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" event={"ID":"2642f097-32a6-4c1a-9ae6-03b9424e845c","Type":"ContainerDied","Data":"e9816881c7c1b3b3cf680625bc60a1dda6c0dae3ab00fa8c2cf5e3921667cc66"}
Nov 02 20:44:59.504593 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.503767    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:44:59.541788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.541697    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:44:59.611484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611447    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.611679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611504    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611563    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.611679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611626    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611679 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611675    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611743    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611758    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611812    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611847    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611876    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611907    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.611941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611937    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611947    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.611968    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612056    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612104    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612163    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612174    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.612290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612177    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.612632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612333    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.612632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612350    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.612632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612358    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.612632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612369    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\") pod \"2642f097-32a6-4c1a-9ae6-03b9424e845c\" (UID: \"2642f097-32a6-4c1a-9ae6-03b9424e845c\") "
Nov 02 20:44:59.612632 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.612417    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\") pod \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\" (UID: \"a36b88af-e35a-4f37-832e-d8ce49ecd03d\") "
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613139    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613143    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613157    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613180    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613194    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613209    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613224    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613237    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613252    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:44:59.613729 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.613381    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.615261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615233    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:44:59.615577 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615551    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:59.615662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615588    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:44:59.615662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615608    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "kube-api-access-j9d6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:59.615875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615852    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "kube-api-access-84mb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:59.615979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.615887    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy" pod "2642f097-32a6-4c1a-9ae6-03b9424e845c" (UID: "2642f097-32a6-4c1a-9ae6-03b9424e845c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.616707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.616663    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:44:59.616946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.616931    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token" pod "a36b88af-e35a-4f37-832e-d8ce49ecd03d" (UID: "a36b88af-e35a-4f37-832e-d8ce49ecd03d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:44:59.714713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.714543    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715178    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715212    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84mb7\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-kube-api-access-84mb7\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715231    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715245    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715259    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715272    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715286    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715300    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9d6w\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-kube-api-access-j9d6w\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715312    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36b88af-e35a-4f37-832e-d8ce49ecd03d-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715325    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2642f097-32a6-4c1a-9ae6-03b9424e845c-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:44:59.715352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:44:59.715338    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2642f097-32a6-4c1a-9ae6-03b9424e845c-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:00.091653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.091573    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:45:00.191249 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.191216    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:00.192070 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192045    5457 cpu_manager.go:414] "containerMap: removing container" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192074    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192096    5457 cpu_manager.go:414] "containerMap: removing container" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192104    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192124    5457 cpu_manager.go:414] "containerMap: removing container" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192131    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192143    5457 cpu_manager.go:414] "containerMap: removing container" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192150    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192170    5457 cpu_manager.go:414] "containerMap: removing container" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192176    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192189    5457 cpu_manager.go:414] "containerMap: removing container" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192195    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192207    5457 cpu_manager.go:414] "containerMap: removing container" podUID="84d5841b-8236-4931-9df6-423f5ddd3283" containerName="payload-processing"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192214    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84d5841b-8236-4931-9df6-423f5ddd3283" containerName="payload-processing"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192234    5457 cpu_manager.go:414] "containerMap: removing container" podUID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192240    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192269    5457 cpu_manager.go:414] "containerMap: removing container" podUID="7d673905-1dee-488d-acf3-b9376b4d3a13" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192278    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d673905-1dee-488d-acf3-b9376b4d3a13" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192294    5457 cpu_manager.go:414] "containerMap: removing container" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192300    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192419    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192434    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="84d5841b-8236-4931-9df6-423f5ddd3283" containerName="payload-processing"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192444    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192455    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="21b2ea50-acc0-4361-8388-8c9b13f4c832" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192464    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192473    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="360c9b31-6e96-4f5c-aa62-e4cb2343b1af" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192485    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d673905-1dee-488d-acf3-b9376b4d3a13" containerName="maas-api"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192497    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d19441a-6597-4b81-ba45-38cee8ba5e46" containerName="istio-proxy"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192507    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="992dfb78-ad4b-465a-99ae-8f514b02ab1a" containerName="main"
Nov 02 20:45:00.192655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.192514    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9e7d7b6-93d8-4b61-a887-9fca549a7eda" containerName="main"
Nov 02 20:45:00.197658 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.197637    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:00.197821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.197799    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.198397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.198377    5457 cpu_manager.go:414] "containerMap: removing container" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.198515 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.198398    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.198587 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.198521    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bd48371-9039-42ca-af86-994c44d9ffe4" containerName="istio-proxy"
Nov 02 20:45:00.202844 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.202821    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:00.202965 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.202940    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.206912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.206890    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.221413 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.221386    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:00.231140 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.231101    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhw7z\" (UniqueName: \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.231481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.231452    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.237433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.237073    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.265656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.265619    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:00.271793 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.271753    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:00.274065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.274043    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:00.290941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.290914    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:00.328820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.328776    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9xknx\""
Nov 02 20:45:00.333439 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333411    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvk2x\" (UniqueName: \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.333602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333583    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.333653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333621    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.333738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333714    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhw7z\" (UniqueName: \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.333836 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333819    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk27k\" (UniqueName: \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.333891 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333857    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.333944 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333924    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.334004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.333960    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxttf\" (UniqueName: \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.334580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.334563    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.391262 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.391233    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhw7z\" (UniqueName: \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\") pod \"maas-api-key-cleanup-29894205-gfndt\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.400726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.400678    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"
Nov 02 20:45:00.401121 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.400671    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt" event={"ID":"a36b88af-e35a-4f37-832e-d8ce49ecd03d","Type":"ContainerDied","Data":"2a7506186079baa2b8f40ddc061677c03b3bd018a91779c92ef425de28e6d4c9"}
Nov 02 20:45:00.401121 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.400844    5457 scope.go:122] "RemoveContainer" containerID="a8d206d741c4642fba9ae934fa07d018ca8e209150935ea66837c8ae88e94cd0"
Nov 02 20:45:00.402831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.402811    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"
Nov 02 20:45:00.402963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.402857    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg" event={"ID":"2642f097-32a6-4c1a-9ae6-03b9424e845c","Type":"ContainerDied","Data":"21030cf1700970cde39306b1c75f4b055e0e8f956d069096f848620bf3715c29"}
Nov 02 20:45:00.412149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.412126    5457 scope.go:122] "RemoveContainer" containerID="e9816881c7c1b3b3cf680625bc60a1dda6c0dae3ab00fa8c2cf5e3921667cc66"
Nov 02 20:45:00.435722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435671    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvk2x\" (UniqueName: \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.435824 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435775    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.435824 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435803    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.435905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435844    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk27k\" (UniqueName: \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.435905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435887    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.436038 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.435923    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxttf\" (UniqueName: \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.436501 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.436479    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.436567 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.436537    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.436610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.436598    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.492988 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.492956    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk27k\" (UniqueName: \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\") pod \"maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.493239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.493028    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvk2x\" (UniqueName: \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\") pod \"maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.493239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.493030    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxttf\" (UniqueName: \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\") pod \"maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.515261 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.515231    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:00.534820 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.534792    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:00.549426 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.549400    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:00.571945 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.571895    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:00.715609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.714777    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:45:00.721529 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.717172    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-bhcnt"]
Nov 02 20:45:00.781146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.781076    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:45:00.784657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:00.784630    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-694cee-openshift-default-84bcc8dfc7-cs2bg"]
Nov 02 20:45:01.078409 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.078381    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:01.080014 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:45:01.079987    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd503e996_3f4d_47c3_95ed_bcd5dc304bfd.slice/crio-cec0f1d89f5811cce44f92eb758ac2ac062feb48bd39a56f66f130378bb2c9c3 WatchSource:0}: Error finding container cec0f1d89f5811cce44f92eb758ac2ac062feb48bd39a56f66f130378bb2c9c3: Status 404 returned error can't find the container with id cec0f1d89f5811cce44f92eb758ac2ac062feb48bd39a56f66f130378bb2c9c3
Nov 02 20:45:01.081867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.081851    5457 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 20:45:01.180894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.180862    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2642f097-32a6-4c1a-9ae6-03b9424e845c" path="/var/lib/kubelet/pods/2642f097-32a6-4c1a-9ae6-03b9424e845c/volumes"
Nov 02 20:45:01.181331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.181317    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a36b88af-e35a-4f37-832e-d8ce49ecd03d" path="/var/lib/kubelet/pods/a36b88af-e35a-4f37-832e-d8ce49ecd03d/volumes"
Nov 02 20:45:01.256300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.256279    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:01.258675 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:45:01.258647    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9717e21f_d799_4275_9750_f30915590fc5.slice/crio-2bd365fcdf1596687465f8fd244ef99960486ce7f4842603f64ea33791f6471e WatchSource:0}: Error finding container 2bd365fcdf1596687465f8fd244ef99960486ce7f4842603f64ea33791f6471e: Status 404 returned error can't find the container with id 2bd365fcdf1596687465f8fd244ef99960486ce7f4842603f64ea33791f6471e
Nov 02 20:45:01.302785 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.302756    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:01.304415 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:45:01.304383    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592cecc7_db7c_4b95_b361_17bd968ad663.slice/crio-8b3ebbed9c42e39871676b7027c9f85d6fc3c989ed54bd9087a712ad5b361ab1 WatchSource:0}: Error finding container 8b3ebbed9c42e39871676b7027c9f85d6fc3c989ed54bd9087a712ad5b361ab1: Status 404 returned error can't find the container with id 8b3ebbed9c42e39871676b7027c9f85d6fc3c989ed54bd9087a712ad5b361ab1
Nov 02 20:45:01.317055 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.317026    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:01.320313 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:45:01.320277    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677ad874_41aa_4846_838a_743a85cf9cfd.slice/crio-5bcfc07718fbf721b08a246627e8f8c15273d9cad28d81dbc3e14d6e2ad93d68 WatchSource:0}: Error finding container 5bcfc07718fbf721b08a246627e8f8c15273d9cad28d81dbc3e14d6e2ad93d68: Status 404 returned error can't find the container with id 5bcfc07718fbf721b08a246627e8f8c15273d9cad28d81dbc3e14d6e2ad93d68
Nov 02 20:45:01.409827 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.409793    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerStarted","Data":"5bcfc07718fbf721b08a246627e8f8c15273d9cad28d81dbc3e14d6e2ad93d68"}
Nov 02 20:45:01.411046 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.411021    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerStarted","Data":"8b3ebbed9c42e39871676b7027c9f85d6fc3c989ed54bd9087a712ad5b361ab1"}
Nov 02 20:45:01.413302 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.413277    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerStarted","Data":"cec0f1d89f5811cce44f92eb758ac2ac062feb48bd39a56f66f130378bb2c9c3"}
Nov 02 20:45:01.414424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:01.414402    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerStarted","Data":"2bd365fcdf1596687465f8fd244ef99960486ce7f4842603f64ea33791f6471e"}
Nov 02 20:45:07.463148 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:07.463108    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerStarted","Data":"f52bc15205b4af6c492aae63247dc5c95552f6b9af7f4241a4e2082273ace0ca"}
Nov 02 20:45:07.465675 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:07.465638    5457 generic.go:356] "Generic (PLEG): container finished" podID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerID="dd2811ef5e4053e368061b362e44b7df8d6b45bdb6445a16c3fdf0f0de7973fc" exitCode=60
Nov 02 20:45:07.465830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:07.465728    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerDied","Data":"dd2811ef5e4053e368061b362e44b7df8d6b45bdb6445a16c3fdf0f0de7973fc"}
Nov 02 20:45:07.465990 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:07.465967    5457 scope.go:122] "RemoveContainer" containerID="dd2811ef5e4053e368061b362e44b7df8d6b45bdb6445a16c3fdf0f0de7973fc"
Nov 02 20:45:07.580424 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:07.580309    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" podStartSLOduration=2.050041204 podStartE2EDuration="7.580289574s" totalImagesPullingTime="5.53024837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:45:07.578937298 +0000 UTC m=+1774.517326367" watchObservedRunningTime="2026-11-02 20:45:07.580289574 +0000 UTC m=+1774.518678644"
Nov 02 20:45:08.473802 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:08.473753    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerStarted","Data":"381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"}
Nov 02 20:45:08.475418 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:08.475391    5457 generic.go:356] "Generic (PLEG): container finished" podID="677ad874-41aa-4846-838a-743a85cf9cfd" containerID="f52bc15205b4af6c492aae63247dc5c95552f6b9af7f4241a4e2082273ace0ca" exitCode=60
Nov 02 20:45:08.475530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:08.475431    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerDied","Data":"f52bc15205b4af6c492aae63247dc5c95552f6b9af7f4241a4e2082273ace0ca"}
Nov 02 20:45:08.475675 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:08.475657    5457 scope.go:122] "RemoveContainer" containerID="f52bc15205b4af6c492aae63247dc5c95552f6b9af7f4241a4e2082273ace0ca"
Nov 02 20:45:08.599636 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:08.599582    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" podStartSLOduration=3.178583124 podStartE2EDuration="8.599563376s" totalImagesPullingTime="5.420980252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:45:08.598648569 +0000 UTC m=+1775.537037641" watchObservedRunningTime="2026-11-02 20:45:08.599563376 +0000 UTC m=+1775.537952446"
Nov 02 20:45:09.483406 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.483366    5457 generic.go:356] "Generic (PLEG): container finished" podID="9717e21f-d799-4275-9750-f30915590fc5" containerID="22e4227da53c03854cdddc672843470a64803d9d185fb362e92c0b58af9cb3f3" exitCode=60
Nov 02 20:45:09.483823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.483446    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerDied","Data":"22e4227da53c03854cdddc672843470a64803d9d185fb362e92c0b58af9cb3f3"}
Nov 02 20:45:09.483823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.483767    5457 scope.go:122] "RemoveContainer" containerID="22e4227da53c03854cdddc672843470a64803d9d185fb362e92c0b58af9cb3f3"
Nov 02 20:45:09.485555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.485529    5457 generic.go:356] "Generic (PLEG): container finished" podID="677ad874-41aa-4846-838a-743a85cf9cfd" containerID="6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8" exitCode=60
Nov 02 20:45:09.485670 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.485614    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerDied","Data":"6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8"}
Nov 02 20:45:09.485789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.485679    5457 scope.go:122] "RemoveContainer" containerID="f52bc15205b4af6c492aae63247dc5c95552f6b9af7f4241a4e2082273ace0ca"
Nov 02 20:45:09.486006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.485980    5457 scope.go:122] "RemoveContainer" containerID="6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8"
Nov 02 20:45:09.486332 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:09.486308    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9_odh-ai-gateway-infra(677ad874-41aa-4846-838a-743a85cf9cfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" podUID="677ad874-41aa-4846-838a-743a85cf9cfd"
Nov 02 20:45:09.487272 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.487249    5457 generic.go:356] "Generic (PLEG): container finished" podID="592cecc7-db7c-4b95-b361-17bd968ad663" containerID="42c5430d5d85bfeb1d0448c834374e900313ac33ad294167a05e276c792a82c5" exitCode=60
Nov 02 20:45:09.487360 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.487325    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerDied","Data":"42c5430d5d85bfeb1d0448c834374e900313ac33ad294167a05e276c792a82c5"}
Nov 02 20:45:09.487557 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.487541    5457 scope.go:122] "RemoveContainer" containerID="42c5430d5d85bfeb1d0448c834374e900313ac33ad294167a05e276c792a82c5"
Nov 02 20:45:09.489318 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.489296    5457 generic.go:356] "Generic (PLEG): container finished" podID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerID="381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4" exitCode=60
Nov 02 20:45:09.489373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.489340    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerDied","Data":"381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"}
Nov 02 20:45:09.489659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.489650    5457 scope.go:122] "RemoveContainer" containerID="381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"
Nov 02 20:45:09.489951 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:09.489926    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894205-gfndt_odh-ai-gateway-infra(d503e996-3f4d-47c3-95ed-bcd5dc304bfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd"
Nov 02 20:45:09.499179 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:09.499157    5457 scope.go:122] "RemoveContainer" containerID="dd2811ef5e4053e368061b362e44b7df8d6b45bdb6445a16c3fdf0f0de7973fc"
Nov 02 20:45:10.498430 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.498405    5457 scope.go:122] "RemoveContainer" containerID="6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8"
Nov 02 20:45:10.498829 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:10.498795    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9_odh-ai-gateway-infra(677ad874-41aa-4846-838a-743a85cf9cfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" podUID="677ad874-41aa-4846-838a-743a85cf9cfd"
Nov 02 20:45:10.500126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.500098    5457 generic.go:356] "Generic (PLEG): container finished" podID="592cecc7-db7c-4b95-b361-17bd968ad663" containerID="5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71" exitCode=60
Nov 02 20:45:10.500246 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.500179    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerDied","Data":"5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71"}
Nov 02 20:45:10.500246 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.500240    5457 scope.go:122] "RemoveContainer" containerID="42c5430d5d85bfeb1d0448c834374e900313ac33ad294167a05e276c792a82c5"
Nov 02 20:45:10.500421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.500406    5457 scope.go:122] "RemoveContainer" containerID="5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71"
Nov 02 20:45:10.500726 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:10.500703    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2_odh-ai-gateway-infra(592cecc7-db7c-4b95-b361-17bd968ad663)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" podUID="592cecc7-db7c-4b95-b361-17bd968ad663"
Nov 02 20:45:10.502011 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.501993    5457 scope.go:122] "RemoveContainer" containerID="381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"
Nov 02 20:45:10.502228 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:10.502206    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894205-gfndt_odh-ai-gateway-infra(d503e996-3f4d-47c3-95ed-bcd5dc304bfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd"
Nov 02 20:45:10.503544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.503523    5457 generic.go:356] "Generic (PLEG): container finished" podID="9717e21f-d799-4275-9750-f30915590fc5" containerID="4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076" exitCode=60
Nov 02 20:45:10.503633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.503569    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerDied","Data":"4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076"}
Nov 02 20:45:10.503818 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.503803    5457 scope.go:122] "RemoveContainer" containerID="4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076"
Nov 02 20:45:10.504010 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:10.503992    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q_odh-ai-gateway-infra(9717e21f-d799-4275-9750-f30915590fc5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" podUID="9717e21f-d799-4275-9750-f30915590fc5"
Nov 02 20:45:10.544977 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:10.544957    5457 scope.go:122] "RemoveContainer" containerID="22e4227da53c03854cdddc672843470a64803d9d185fb362e92c0b58af9cb3f3"
Nov 02 20:45:11.110943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:11.110905    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:45:11.542540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:11.541100    5457 scope.go:122] "RemoveContainer" containerID="4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076"
Nov 02 20:45:11.542540 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:11.541481    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q_odh-ai-gateway-infra(9717e21f-d799-4275-9750-f30915590fc5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" podUID="9717e21f-d799-4275-9750-f30915590fc5"
Nov 02 20:45:11.546721 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:11.545026    5457 scope.go:122] "RemoveContainer" containerID="5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71"
Nov 02 20:45:11.546721 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:11.545754    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2_odh-ai-gateway-infra(592cecc7-db7c-4b95-b361-17bd968ad663)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" podUID="592cecc7-db7c-4b95-b361-17bd968ad663"
Nov 02 20:45:15.112433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.112387    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main" containerID="cri-o://3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5" gracePeriod=45
Nov 02 20:45:15.377780 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.377725    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:45:15.435633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435602    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.435804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435775    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.435848 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435817    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\" (UniqueName: \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.435848 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435842    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.435939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435858    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.435939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435862    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:15.435939 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.435892    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\" (UniqueName: \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\") pod \"a03e6104-43fb-44b2-a69d-ba37875a5338\" (UID: \"a03e6104-43fb-44b2-a69d-ba37875a5338\") "
Nov 02 20:45:15.436139 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.436117    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:15.436139 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.436128    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:15.436555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.436530    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.436555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.436553    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.436779 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.436564    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.438106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.438077    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:45:15.438106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.438084    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:15.438226 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.438145    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk" pod "a03e6104-43fb-44b2-a69d-ba37875a5338" (UID: "a03e6104-43fb-44b2-a69d-ba37875a5338"). InnerVolumeSpecName "kube-api-access-kdmxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:15.537882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.537847    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a03e6104-43fb-44b2-a69d-ba37875a5338-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.537882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.537876    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a03e6104-43fb-44b2-a69d-ba37875a5338-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.537882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.537887    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmxk\" (UniqueName: \"kubernetes.io/projected/a03e6104-43fb-44b2-a69d-ba37875a5338-kube-api-access-kdmxk\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:15.615794 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.615759    5457 generic.go:356] "Generic (PLEG): container finished" podID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerID="3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5" exitCode=0
Nov 02 20:45:15.615963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.615814    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"
Nov 02 20:45:15.615963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.615826    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" event={"ID":"a03e6104-43fb-44b2-a69d-ba37875a5338","Type":"ContainerDied","Data":"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"}
Nov 02 20:45:15.615963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.615857    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s" event={"ID":"a03e6104-43fb-44b2-a69d-ba37875a5338","Type":"ContainerDied","Data":"56492de8a8fe61caddb11ac262d7eee255159c4b2655e6dc1f075a2862b71e56"}
Nov 02 20:45:15.615963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.615874    5457 scope.go:122] "RemoveContainer" containerID="3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"
Nov 02 20:45:15.625738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.625717    5457 scope.go:122] "RemoveContainer" containerID="3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"
Nov 02 20:45:15.626005 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:15.625982    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5\": container with ID starting with 3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5 not found: ID does not exist" containerID="3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"
Nov 02 20:45:15.626071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.626013    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5"} err="failed to get container status \"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5\": rpc error: code = NotFound desc = could not find container \"3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5\": container with ID starting with 3e9731b05c5516c49af62b94958de167f73146ee91facd2b01741bbde93a7bd5 not found: ID does not exist"
Nov 02 20:45:15.771826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.771774    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:45:15.779518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:15.779485    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-bce768/distinct-2-w4-bce768-kserve-5cfb84467f-gst5s"]
Nov 02 20:45:17.290732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:17.285569    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" path="/var/lib/kubelet/pods/a03e6104-43fb-44b2-a69d-ba37875a5338/volumes"
Nov 02 20:45:22.167156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.167118    5457 scope.go:122] "RemoveContainer" containerID="4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076"
Nov 02 20:45:22.167617 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.167248    5457 scope.go:122] "RemoveContainer" containerID="5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71"
Nov 02 20:45:22.167617 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.167392    5457 scope.go:122] "RemoveContainer" containerID="381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"
Nov 02 20:45:22.663361 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.663329    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerStarted","Data":"49ce4c853a2de309a57274d851a489bfd2596d22b9450b71e49b1476acb98ff5"}
Nov 02 20:45:22.665258 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.665233    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerStarted","Data":"7c9c22977537c1506cbbb22f83578a4a25306252b9ce14bd25c2b0883e73145c"}
Nov 02 20:45:22.667017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.666996    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerStarted","Data":"e0ab70bf177576a97012562d7aab1f0ed9903d431ccf16dbf18184f588da9a20"}
Nov 02 20:45:22.877913 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.877799    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" podStartSLOduration=16.029306674 podStartE2EDuration="22.877781571s" totalImagesPullingTime="6.848474897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:45:22.877490025 +0000 UTC m=+1789.815879095" watchObservedRunningTime="2026-11-02 20:45:22.877781571 +0000 UTC m=+1789.816170640"
Nov 02 20:45:22.984879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:22.984822    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" podStartSLOduration=16.179414765 podStartE2EDuration="22.984806787s" totalImagesPullingTime="6.805392022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:45:22.984294554 +0000 UTC m=+1789.922683623" watchObservedRunningTime="2026-11-02 20:45:22.984806787 +0000 UTC m=+1789.923195854"
Nov 02 20:45:23.182708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.177798    5457 scope.go:122] "RemoveContainer" containerID="6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8"
Nov 02 20:45:23.674574 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.674542    5457 generic.go:356] "Generic (PLEG): container finished" podID="9717e21f-d799-4275-9750-f30915590fc5" containerID="7c9c22977537c1506cbbb22f83578a4a25306252b9ce14bd25c2b0883e73145c" exitCode=60
Nov 02 20:45:23.674732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.674615    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerDied","Data":"7c9c22977537c1506cbbb22f83578a4a25306252b9ce14bd25c2b0883e73145c"}
Nov 02 20:45:23.674732 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.674673    5457 scope.go:122] "RemoveContainer" containerID="4369208d2ab1a4e6df773c516d02d8bcedcca2421282ccb29bcf154de357a076"
Nov 02 20:45:23.675112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.675091    5457 scope.go:122] "RemoveContainer" containerID="7c9c22977537c1506cbbb22f83578a4a25306252b9ce14bd25c2b0883e73145c"
Nov 02 20:45:23.675471 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:23.675443    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q_odh-ai-gateway-infra(9717e21f-d799-4275-9750-f30915590fc5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" podUID="9717e21f-d799-4275-9750-f30915590fc5"
Nov 02 20:45:23.677148 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.677115    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerStarted","Data":"aaddc62028e29736b2c7d924c2ac4ca54f3af41c99d9cff5fdebfafd6616e339"}
Nov 02 20:45:23.679667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.679633    5457 generic.go:356] "Generic (PLEG): container finished" podID="592cecc7-db7c-4b95-b361-17bd968ad663" containerID="e0ab70bf177576a97012562d7aab1f0ed9903d431ccf16dbf18184f588da9a20" exitCode=60
Nov 02 20:45:23.679767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.679726    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerDied","Data":"e0ab70bf177576a97012562d7aab1f0ed9903d431ccf16dbf18184f588da9a20"}
Nov 02 20:45:23.680112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.680087    5457 scope.go:122] "RemoveContainer" containerID="e0ab70bf177576a97012562d7aab1f0ed9903d431ccf16dbf18184f588da9a20"
Nov 02 20:45:23.680414 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:23.680391    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2_odh-ai-gateway-infra(592cecc7-db7c-4b95-b361-17bd968ad663)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" podUID="592cecc7-db7c-4b95-b361-17bd968ad663"
Nov 02 20:45:23.681874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.681852    5457 generic.go:356] "Generic (PLEG): container finished" podID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerID="49ce4c853a2de309a57274d851a489bfd2596d22b9450b71e49b1476acb98ff5" exitCode=60
Nov 02 20:45:23.681987 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.681927    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerDied","Data":"49ce4c853a2de309a57274d851a489bfd2596d22b9450b71e49b1476acb98ff5"}
Nov 02 20:45:23.682314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.682296    5457 scope.go:122] "RemoveContainer" containerID="49ce4c853a2de309a57274d851a489bfd2596d22b9450b71e49b1476acb98ff5"
Nov 02 20:45:23.682551 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:23.682533    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29894205-gfndt_odh-ai-gateway-infra(d503e996-3f4d-47c3-95ed-bcd5dc304bfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd"
Nov 02 20:45:23.689610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.689526    5457 scope.go:122] "RemoveContainer" containerID="5a8014ac437c7702a082258f931d59fcdc5693a9a1a904b63b20af8525aecf71"
Nov 02 20:45:23.703788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.703759    5457 scope.go:122] "RemoveContainer" containerID="381ec5794740b3ec3897ab1d670bcbf3470d4e2cae5e2b1b1244eb980b9323d4"
Nov 02 20:45:23.785487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.785396    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:23.812310 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:23.812263    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:45:23.890498 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.890469    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:23.994437 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:23.994406    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:24.691637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.691601    5457 generic.go:356] "Generic (PLEG): container finished" podID="677ad874-41aa-4846-838a-743a85cf9cfd" containerID="aaddc62028e29736b2c7d924c2ac4ca54f3af41c99d9cff5fdebfafd6616e339" exitCode=60
Nov 02 20:45:24.692144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.691678    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerDied","Data":"aaddc62028e29736b2c7d924c2ac4ca54f3af41c99d9cff5fdebfafd6616e339"}
Nov 02 20:45:24.692144 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.691756    5457 scope.go:122] "RemoveContainer" containerID="6fcf143169de4ea95aefd28b898b26f18d2b10876523bfacf967fea8388b0db8"
Nov 02 20:45:24.692265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.692175    5457 scope.go:122] "RemoveContainer" containerID="aaddc62028e29736b2c7d924c2ac4ca54f3af41c99d9cff5fdebfafd6616e339"
Nov 02 20:45:24.692528 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:24.692507    5457 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9_odh-ai-gateway-infra(677ad874-41aa-4846-838a-743a85cf9cfd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" podUID="677ad874-41aa-4846-838a-743a85cf9cfd"
Nov 02 20:45:24.864764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.864738    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:24.933292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.933266    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\") pod \"9717e21f-d799-4275-9750-f30915590fc5\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") "
Nov 02 20:45:24.933425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.933380    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\" (UniqueName: \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\") pod \"9717e21f-d799-4275-9750-f30915590fc5\" (UID: \"9717e21f-d799-4275-9750-f30915590fc5\") "
Nov 02 20:45:24.933610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.933589    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:24.933727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.933656    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca" pod "9717e21f-d799-4275-9750-f30915590fc5" (UID: "9717e21f-d799-4275-9750-f30915590fc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:45:24.933975 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.933954    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9717e21f-d799-4275-9750-f30915590fc5-maas-api-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:24.936017 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.935996    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x" pod "9717e21f-d799-4275-9750-f30915590fc5" (UID: "9717e21f-d799-4275-9750-f30915590fc5"). InnerVolumeSpecName "kube-api-access-dvk2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:24.936788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:24.936764    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:25.034719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.034627    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\") pod \"592cecc7-db7c-4b95-b361-17bd968ad663\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") "
Nov 02 20:45:25.034719 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.034676    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\" (UniqueName: \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\") pod \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") "
Nov 02 20:45:25.035000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.034909    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\" (UniqueName: \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\") pod \"592cecc7-db7c-4b95-b361-17bd968ad663\" (UID: \"592cecc7-db7c-4b95-b361-17bd968ad663\") "
Nov 02 20:45:25.035000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.034958    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\") pod \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\" (UID: \"d503e996-3f4d-47c3-95ed-bcd5dc304bfd\") "
Nov 02 20:45:25.035104 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.035025    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca" pod "592cecc7-db7c-4b95-b361-17bd968ad663" (UID: "592cecc7-db7c-4b95-b361-17bd968ad663"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:45:25.035374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.035349    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca" pod "d503e996-3f4d-47c3-95ed-bcd5dc304bfd" (UID: "d503e996-3f4d-47c3-95ed-bcd5dc304bfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:45:25.035460 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.035443    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592cecc7-db7c-4b95-b361-17bd968ad663-maas-api-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.035508 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.035463    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvk2x\" (UniqueName: \"kubernetes.io/projected/9717e21f-d799-4275-9750-f30915590fc5-kube-api-access-dvk2x\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.036412 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.036391    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:25.036824 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.036799    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z" pod "d503e996-3f4d-47c3-95ed-bcd5dc304bfd" (UID: "d503e996-3f4d-47c3-95ed-bcd5dc304bfd"). InnerVolumeSpecName "kube-api-access-nhw7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:25.036948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.036929    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf" pod "592cecc7-db7c-4b95-b361-17bd968ad663" (UID: "592cecc7-db7c-4b95-b361-17bd968ad663"). InnerVolumeSpecName "kube-api-access-sxttf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:25.137237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.137204    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxttf\" (UniqueName: \"kubernetes.io/projected/592cecc7-db7c-4b95-b361-17bd968ad663-kube-api-access-sxttf\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.137237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.137233    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-maas-api-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.137237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.137243    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhw7z\" (UniqueName: \"kubernetes.io/projected/d503e996-3f4d-47c3-95ed-bcd5dc304bfd-kube-api-access-nhw7z\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.704822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.704789    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"
Nov 02 20:45:25.705315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.704818    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt" event={"ID":"d503e996-3f4d-47c3-95ed-bcd5dc304bfd","Type":"ContainerDied","Data":"cec0f1d89f5811cce44f92eb758ac2ac062feb48bd39a56f66f130378bb2c9c3"}
Nov 02 20:45:25.705315 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.704879    5457 scope.go:122] "RemoveContainer" containerID="49ce4c853a2de309a57274d851a489bfd2596d22b9450b71e49b1476acb98ff5"
Nov 02 20:45:25.706339 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.706320    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"
Nov 02 20:45:25.706462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.706370    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q" event={"ID":"9717e21f-d799-4275-9750-f30915590fc5","Type":"ContainerDied","Data":"2bd365fcdf1596687465f8fd244ef99960486ce7f4842603f64ea33791f6471e"}
Nov 02 20:45:25.709960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.709938    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"
Nov 02 20:45:25.710057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.709935    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2" event={"ID":"592cecc7-db7c-4b95-b361-17bd968ad663","Type":"ContainerDied","Data":"8b3ebbed9c42e39871676b7027c9f85d6fc3c989ed54bd9087a712ad5b361ab1"}
Nov 02 20:45:25.715576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.715559    5457 scope.go:122] "RemoveContainer" containerID="7c9c22977537c1506cbbb22f83578a4a25306252b9ce14bd25c2b0883e73145c"
Nov 02 20:45:25.724107 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.724072    5457 scope.go:122] "RemoveContainer" containerID="e0ab70bf177576a97012562d7aab1f0ed9903d431ccf16dbf18184f588da9a20"
Nov 02 20:45:25.851204 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.851180    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:25.858705 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.858659    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:25.862197 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.862176    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bce768-29894205-thm5q"]
Nov 02 20:45:25.947131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.947094    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\" (UniqueName: \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\") pod \"677ad874-41aa-4846-838a-743a85cf9cfd\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") "
Nov 02 20:45:25.947297 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.947263    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\") pod \"677ad874-41aa-4846-838a-743a85cf9cfd\" (UID: \"677ad874-41aa-4846-838a-743a85cf9cfd\") "
Nov 02 20:45:25.947619 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.947592    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca" pod "677ad874-41aa-4846-838a-743a85cf9cfd" (UID: "677ad874-41aa-4846-838a-743a85cf9cfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:45:25.947821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.947801    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/677ad874-41aa-4846-838a-743a85cf9cfd-maas-api-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:25.949393 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.949371    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k" pod "677ad874-41aa-4846-838a-743a85cf9cfd" (UID: "677ad874-41aa-4846-838a-743a85cf9cfd"). InnerVolumeSpecName "kube-api-access-kk27k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:25.963828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.963789    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:25.970654 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:25.970630    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894205-gfndt"]
Nov 02 20:45:26.049181 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.049156    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk27k\" (UniqueName: \"kubernetes.io/projected/677ad874-41aa-4846-838a-743a85cf9cfd-kube-api-access-kk27k\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:26.181609 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.181575    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:26.186023 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.185998    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a5cad4-29894205-bxsw2"]
Nov 02 20:45:26.717281 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.717249    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"
Nov 02 20:45:26.717788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.717244    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9" event={"ID":"677ad874-41aa-4846-838a-743a85cf9cfd","Type":"ContainerDied","Data":"5bcfc07718fbf721b08a246627e8f8c15273d9cad28d81dbc3e14d6e2ad93d68"}
Nov 02 20:45:26.717788 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.717381    5457 scope.go:122] "RemoveContainer" containerID="aaddc62028e29736b2c7d924c2ac4ca54f3af41c99d9cff5fdebfafd6616e339"
Nov 02 20:45:26.870363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.870326    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:26.874365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:26.874341    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-30ee89-29894205-zzqj9"]
Nov 02 20:45:27.173224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:27.173191    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" path="/var/lib/kubelet/pods/592cecc7-db7c-4b95-b361-17bd968ad663/volumes"
Nov 02 20:45:27.173657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:27.173643    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" path="/var/lib/kubelet/pods/677ad874-41aa-4846-838a-743a85cf9cfd/volumes"
Nov 02 20:45:27.174063 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:27.174050    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9717e21f-d799-4275-9750-f30915590fc5" path="/var/lib/kubelet/pods/9717e21f-d799-4275-9750-f30915590fc5/volumes"
Nov 02 20:45:27.174831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:27.174806    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" path="/var/lib/kubelet/pods/d503e996-3f4d-47c3-95ed-bcd5dc304bfd/volumes"
Nov 02 20:45:29.152856 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.152821    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:45:29.153371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153357    5457 cpu_manager.go:414] "containerMap: removing container" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153372    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153381    5457 cpu_manager.go:414] "containerMap: removing container" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153386    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153395    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153400    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153412    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.153425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153416    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153443    5457 cpu_manager.go:414] "containerMap: removing container" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153447    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153455    5457 cpu_manager.go:414] "containerMap: removing container" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153459    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153474    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153481    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153490    5457 cpu_manager.go:414] "containerMap: removing container" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153494    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153523    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153529    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153544    5457 cpu_manager.go:414] "containerMap: removing container" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153549    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153649    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.153653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153658    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="a03e6104-43fb-44b2-a69d-ba37875a5338" containerName="main"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153665    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153670    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153678    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153699    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153705    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153713    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153719    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153724    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:45:29.154042 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.153730    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:45:29.158481 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.158460    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.197956 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.197929    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.198085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.197966    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.198085 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.198048    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.198266 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.198239    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64b5\" (UniqueName: \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.207116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.207090    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w0-18fd4c-serving-cert\""
Nov 02 20:45:29.256291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.256258    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:45:29.299682 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.299641    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.299834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.299723    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.299834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.299754    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.299834 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:29.299781    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-serving-cert: secret "maas-api-e2e-shared-b-w0-18fd4c-serving-cert" not found
Nov 02 20:45:29.299834 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:29.299834    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls podName:38637135-b4b9-4198-bb33-68dc2502717d nodeName:}" failed. No retries permitted until 2026-11-02 20:45:29.799820109 +0000 UTC m=+1796.738209173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls") pod "maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" (UID: "38637135-b4b9-4198-bb33-68dc2502717d") : secret "maas-api-e2e-shared-b-w0-18fd4c-serving-cert" not found
Nov 02 20:45:29.299985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.299817    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64b5\" (UniqueName: \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.300347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.300323    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.302186 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.302166    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.357184 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.357157    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64b5\" (UniqueName: \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.808280 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.808240    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:29.810790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:29.810760    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:30.071638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:30.071552    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:30.599812 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:30.587565    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:45:30.794459 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:30.794413    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" event={"ID":"38637135-b4b9-4198-bb33-68dc2502717d","Type":"ContainerStarted","Data":"01a11006b3e535f7ee953335245c78076e24a7ba2ee1fdee0b8efc23d8643572"}
Nov 02 20:45:31.805477 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:31.805419    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" event={"ID":"38637135-b4b9-4198-bb33-68dc2502717d","Type":"ContainerStarted","Data":"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"}
Nov 02 20:45:31.806032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:31.805662    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:31.939708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:31.934892    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" podStartSLOduration=1.925746983 podStartE2EDuration="2.934868177s" totalImagesPullingTime="1.009121194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:45:31.920139064 +0000 UTC m=+1798.858528132" watchObservedRunningTime="2026-11-02 20:45:31.934868177 +0000 UTC m=+1798.873257270"
Nov 02 20:45:33.419360 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:33.419330    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:45:33.420102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:33.420077    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:45:37.837709 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:37.833919    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:45:39.493707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:39.489982    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:45:39.493707 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:39.490276    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" containerID="cri-o://b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309" gracePeriod=30
Nov 02 20:45:43.905174 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:43.905093    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:45:44.759441 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.759413    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:45:44.857446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857369    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857403    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857446 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857431    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857455    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857497    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857665    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857764 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857750    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857775    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:44.857982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857805    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:44.857982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857882    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.857982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857931    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:44.857982 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.857957    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\") pod \"cf017c6f-7385-4244-b289-80401550e98f\" (UID: \"cf017c6f-7385-4244-b289-80401550e98f\") "
Nov 02 20:45:44.858238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858037    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:45:44.858238 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858194    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:44.858593 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858563    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.858653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858594    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.858653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858609    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.858653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858624    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf017c6f-7385-4244-b289-80401550e98f-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.858653 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.858638    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.859845 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.859819    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:45:44.859946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.859908    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:44.860123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.860096    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:45:44.860123 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.860116    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79" pod "cf017c6f-7385-4244-b289-80401550e98f" (UID: "cf017c6f-7385-4244-b289-80401550e98f"). InnerVolumeSpecName "kube-api-access-72h79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:45:44.959758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.959728    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72h79\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-kube-api-access-72h79\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.959758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.959757    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf017c6f-7385-4244-b289-80401550e98f-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.960172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.959767    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf017c6f-7385-4244-b289-80401550e98f-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:44.960172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:44.959776    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf017c6f-7385-4244-b289-80401550e98f-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:45:45.016429 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.016392    5457 generic.go:356] "Generic (PLEG): container finished" podID="cf017c6f-7385-4244-b289-80401550e98f" containerID="b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309" exitCode=0
Nov 02 20:45:45.016611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.016446    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"
Nov 02 20:45:45.016611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.016474    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" event={"ID":"cf017c6f-7385-4244-b289-80401550e98f","Type":"ContainerDied","Data":"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"}
Nov 02 20:45:45.016611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.016571    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" event={"ID":"cf017c6f-7385-4244-b289-80401550e98f","Type":"ContainerDied","Data":"f0a10ee64446ef36764e6e43e4b7ae447e0ffc75f03204d9229b528ed4b3b56f"}
Nov 02 20:45:45.016611 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.016599    5457 scope.go:122] "RemoveContainer" containerID="b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"
Nov 02 20:45:45.027522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.027498    5457 scope.go:122] "RemoveContainer" containerID="b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"
Nov 02 20:45:45.027821 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:45.027800    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309\": container with ID starting with b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309 not found: ID does not exist" containerID="b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"
Nov 02 20:45:45.027901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.027828    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309"} err="failed to get container status \"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309\": rpc error: code = NotFound desc = could not find container \"b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309\": container with ID starting with b062942b3bb5865c3f0b53a11ba97b9e7318518980bb10adbf7642cab4895309 not found: ID does not exist"
Nov 02 20:45:45.174398 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.174370    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:45:45.185223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.185199    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v"]
Nov 02 20:45:45.744010 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.743972    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 20:45:45.744180 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:45.744043    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-mqx5v" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:45:47.176464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:45:47.176432    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf017c6f-7385-4244-b289-80401550e98f" path="/var/lib/kubelet/pods/cf017c6f-7385-4244-b289-80401550e98f/volumes"
Nov 02 20:45:53.808499 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:45:53.808460    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:46:14.539121 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:14.539086    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:46:14.660091 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:14.660059    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:46:19.540211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.540158    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" podUID="439eee24-7a80-4e98-b41b-ac41dfb9209e" containerName="payload-processing" containerID="cri-o://3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2" gracePeriod=25
Nov 02 20:46:19.660579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.660540    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" podUID="785d56fe-d51f-4b76-8f06-c524928f1340" containerName="payload-pre-processing" containerID="cri-o://26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232" gracePeriod=25
Nov 02 20:46:19.801210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.801152    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:46:19.931217 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.931187    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:46:19.970469 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.970438    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\") pod \"439eee24-7a80-4e98-b41b-ac41dfb9209e\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") "
Nov 02 20:46:19.970612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.970556    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\" (UniqueName: \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\") pod \"439eee24-7a80-4e98-b41b-ac41dfb9209e\" (UID: \"439eee24-7a80-4e98-b41b-ac41dfb9209e\") "
Nov 02 20:46:19.970835 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.970815    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume" pod "439eee24-7a80-4e98-b41b-ac41dfb9209e" (UID: "439eee24-7a80-4e98-b41b-ac41dfb9209e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:19.972423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:19.972402    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf" pod "439eee24-7a80-4e98-b41b-ac41dfb9209e" (UID: "439eee24-7a80-4e98-b41b-ac41dfb9209e"). InnerVolumeSpecName "kube-api-access-sqzlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:20.072082 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072000    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\") pod \"785d56fe-d51f-4b76-8f06-c524928f1340\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") "
Nov 02 20:46:20.072245 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072092    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\" (UniqueName: \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\") pod \"785d56fe-d51f-4b76-8f06-c524928f1340\" (UID: \"785d56fe-d51f-4b76-8f06-c524928f1340\") "
Nov 02 20:46:20.072397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072369    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume" pod "785d56fe-d51f-4b76-8f06-c524928f1340" (UID: "785d56fe-d51f-4b76-8f06-c524928f1340"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:20.072723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072704    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/785d56fe-d51f-4b76-8f06-c524928f1340-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:20.072848 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072832    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/439eee24-7a80-4e98-b41b-ac41dfb9209e-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:20.072848 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.072849    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqzlf\" (UniqueName: \"kubernetes.io/projected/439eee24-7a80-4e98-b41b-ac41dfb9209e-kube-api-access-sqzlf\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:20.074616 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.074591    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg" pod "785d56fe-d51f-4b76-8f06-c524928f1340" (UID: "785d56fe-d51f-4b76-8f06-c524928f1340"). InnerVolumeSpecName "kube-api-access-9cbsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:20.173606 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.173578    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cbsg\" (UniqueName: \"kubernetes.io/projected/785d56fe-d51f-4b76-8f06-c524928f1340-kube-api-access-9cbsg\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:20.249409 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.249374    5457 generic.go:356] "Generic (PLEG): container finished" podID="785d56fe-d51f-4b76-8f06-c524928f1340" containerID="26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232" exitCode=0
Nov 02 20:46:20.249600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.249415    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"
Nov 02 20:46:20.249600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.249469    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" event={"ID":"785d56fe-d51f-4b76-8f06-c524928f1340","Type":"ContainerDied","Data":"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"}
Nov 02 20:46:20.249600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.249540    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7" event={"ID":"785d56fe-d51f-4b76-8f06-c524928f1340","Type":"ContainerDied","Data":"99f399993ea7705f8fc54768c86f77c026df646dbfd1a26076d26d1f6ba61463"}
Nov 02 20:46:20.249600 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.249570    5457 scope.go:122] "RemoveContainer" containerID="26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"
Nov 02 20:46:20.250989 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.250964    5457 generic.go:356] "Generic (PLEG): container finished" podID="439eee24-7a80-4e98-b41b-ac41dfb9209e" containerID="3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2" exitCode=0
Nov 02 20:46:20.251093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.251017    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"
Nov 02 20:46:20.251093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.251021    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" event={"ID":"439eee24-7a80-4e98-b41b-ac41dfb9209e","Type":"ContainerDied","Data":"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"}
Nov 02 20:46:20.251093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.251061    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw" event={"ID":"439eee24-7a80-4e98-b41b-ac41dfb9209e","Type":"ContainerDied","Data":"9b84edea6c0c370a168f082ae4a7d34b41c3a56bbeb9add05893a077dfcf76ca"}
Nov 02 20:46:20.260950 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.260930    5457 scope.go:122] "RemoveContainer" containerID="26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"
Nov 02 20:46:20.261246 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:20.261225    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232\": container with ID starting with 26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232 not found: ID does not exist" containerID="26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"
Nov 02 20:46:20.261335 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.261256    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232"} err="failed to get container status \"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232\": rpc error: code = NotFound desc = could not find container \"26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232\": container with ID starting with 26df6c4f774d7c2831cf0488362f40c14bf53617382236d4ca382456f37a8232 not found: ID does not exist"
Nov 02 20:46:20.261335 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.261278    5457 scope.go:122] "RemoveContainer" containerID="3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"
Nov 02 20:46:20.269809 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.269794    5457 scope.go:122] "RemoveContainer" containerID="3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"
Nov 02 20:46:20.270050 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:20.270032    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2\": container with ID starting with 3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2 not found: ID does not exist" containerID="3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"
Nov 02 20:46:20.270093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.270057    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2"} err="failed to get container status \"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2\": rpc error: code = NotFound desc = could not find container \"3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2\": container with ID starting with 3a118889df201e2e90ef74e5e8f8d553d9706aedafe8b64492c6e7bebad4cfc2 not found: ID does not exist"
Nov 02 20:46:20.408714 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.406241    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:46:20.412474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.412443    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-654ae4-7c578cf5d8-rlpgw"]
Nov 02 20:46:20.513899 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.513868    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:46:20.518209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:20.518177    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-654ae4-6f55f8867-8jpq7"]
Nov 02 20:46:21.173486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:21.173444    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="439eee24-7a80-4e98-b41b-ac41dfb9209e" path="/var/lib/kubelet/pods/439eee24-7a80-4e98-b41b-ac41dfb9209e/volumes"
Nov 02 20:46:21.173909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:21.173901    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="785d56fe-d51f-4b76-8f06-c524928f1340" path="/var/lib/kubelet/pods/785d56fe-d51f-4b76-8f06-c524928f1340/volumes"
Nov 02 20:46:23.808206 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:23.808173    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:46:24.740486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.740449    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:46:24.740766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.740713    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" containerID="cri-o://d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b" gracePeriod=30
Nov 02 20:46:24.758880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.758851    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:46:24.759073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.759051    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" containerID="cri-o://6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd" gracePeriod=30
Nov 02 20:46:24.778929 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.778904    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:46:24.779090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:24.779071    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" containerID="cri-o://8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894" gracePeriod=30
Nov 02 20:46:27.478233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:27.478193    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:46:27.532589 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:27.532551    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:46:27.532765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:27.532609    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:46:29.715775 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:29.715737    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:46:29.716214 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:29.715803    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:46:29.740958 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:29.740923    5457 patch_prober.go:29] interesting pod/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:46:29.741101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:29.740986    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:46:30.045106 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.045073    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:46:30.085056 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.085033    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:46:30.106938 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.106914    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:46:30.107118 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107099    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107195 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107167    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107251 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107230    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.107305 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107264    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107305 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107297    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107324    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.107399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107333    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.107399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107362    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107410    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107447    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.107544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107504    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.107544 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107533    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.107795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107560    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:30.107795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107580    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.107795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107734    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.107795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107788    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107825    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107833    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107881    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107918    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107932    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107948    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107948    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.108004 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.107998    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\") pod \"c20eac7b-4a50-467b-9131-e8093629b786\" (UID: \"c20eac7b-4a50-467b-9131-e8093629b786\") "
Nov 02 20:46:30.108409 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108033    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\") pod \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\" (UID: \"ae4744b4-2b2d-43ba-8837-4717b1c913f1\") "
Nov 02 20:46:30.108409 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108174    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:30.108597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108577    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.108655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108602    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.108655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108617    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.108655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108631    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c20eac7b-4a50-467b-9131-e8093629b786-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.108854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108672    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.108854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108753    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.108854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.108522    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.109116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.109078    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.109116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.109109    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.109252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.109123    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.109937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.109912    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:46:30.110051 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.109934    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.110124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.110106    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "kube-api-access-gswrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.110992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.110971    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.110992 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.110978    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.111147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.111001    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.111602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.111581    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb" pod "ae4744b4-2b2d-43ba-8837-4717b1c913f1" (UID: "ae4744b4-2b2d-43ba-8837-4717b1c913f1"). InnerVolumeSpecName "kube-api-access-mctdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.112168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.112146    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo" pod "c20eac7b-4a50-467b-9131-e8093629b786" (UID: "c20eac7b-4a50-467b-9131-e8093629b786"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:46:30.210374 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210341    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210423    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210458    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210515    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210543    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210603    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210653    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210790 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210705    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.210926 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210809    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.210926 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.210858    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\") pod \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\" (UID: \"8754a7e5-161b-4b08-a5c3-0cf6124c003a\") "
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211098    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211181    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211330    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211413    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c20eac7b-4a50-467b-9131-e8093629b786-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211433    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211444    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211453    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211462    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211470    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c20eac7b-4a50-467b-9131-e8093629b786-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211480    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4744b4-2b2d-43ba-8837-4717b1c913f1-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211491    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211498    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211537    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211556    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gswrp\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-kube-api-access-gswrp\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.211126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211571    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c20eac7b-4a50-467b-9131-e8093629b786-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.212415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211584    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4744b4-2b2d-43ba-8837-4717b1c913f1-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.212415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.211597    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mctdb\" (UniqueName: \"kubernetes.io/projected/ae4744b4-2b2d-43ba-8837-4717b1c913f1-kube-api-access-mctdb\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.213519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.213462    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:30.213760 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.213738    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "kube-api-access-x29ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.213854 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.213831    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:46:30.213946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.213930    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token" pod "8754a7e5-161b-4b08-a5c3-0cf6124c003a" (UID: "8754a7e5-161b-4b08-a5c3-0cf6124c003a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:30.312320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312229    5457 generic.go:356] "Generic (PLEG): container finished" podID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerID="6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd" exitCode=0
Nov 02 20:46:30.312320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312271    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"
Nov 02 20:46:30.312320 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312308    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" event={"ID":"ae4744b4-2b2d-43ba-8837-4717b1c913f1","Type":"ContainerDied","Data":"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"}
Nov 02 20:46:30.312559 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312361    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg" event={"ID":"ae4744b4-2b2d-43ba-8837-4717b1c913f1","Type":"ContainerDied","Data":"17f7dde0e0b636686bab92741d104b17a0a9c883d562a0ea0c5a1371f311f141"}
Nov 02 20:46:30.312559 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312391    5457 scope.go:122] "RemoveContainer" containerID="6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312656    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312708    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312723    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312738    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x29ml\" (UniqueName: \"kubernetes.io/projected/8754a7e5-161b-4b08-a5c3-0cf6124c003a-kube-api-access-x29ml\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312752    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8754a7e5-161b-4b08-a5c3-0cf6124c003a-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.312789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.312765    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8754a7e5-161b-4b08-a5c3-0cf6124c003a-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:30.314128 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.314104    5457 generic.go:356] "Generic (PLEG): container finished" podID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerID="8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894" exitCode=0
Nov 02 20:46:30.314248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.314168    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"
Nov 02 20:46:30.314248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.314187    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" event={"ID":"8754a7e5-161b-4b08-a5c3-0cf6124c003a","Type":"ContainerDied","Data":"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"}
Nov 02 20:46:30.314248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.314232    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9" event={"ID":"8754a7e5-161b-4b08-a5c3-0cf6124c003a","Type":"ContainerDied","Data":"18960650060b6c4f879a8d3e9ef51d0a6f832ebefaa107ce5dfc82fbb9c0d09e"}
Nov 02 20:46:30.315566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.315544    5457 generic.go:356] "Generic (PLEG): container finished" podID="c20eac7b-4a50-467b-9131-e8093629b786" containerID="d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b" exitCode=0
Nov 02 20:46:30.315676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.315574    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" event={"ID":"c20eac7b-4a50-467b-9131-e8093629b786","Type":"ContainerDied","Data":"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"}
Nov 02 20:46:30.315676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.315606    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"
Nov 02 20:46:30.315676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.315615    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc" event={"ID":"c20eac7b-4a50-467b-9131-e8093629b786","Type":"ContainerDied","Data":"070ba598b6f3740d12a60cc086a230e6753f22f1d0539581ad3848441d6c1078"}
Nov 02 20:46:30.323905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.323887    5457 scope.go:122] "RemoveContainer" containerID="6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"
Nov 02 20:46:30.324772 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:30.324246    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd\": container with ID starting with 6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd not found: ID does not exist" containerID="6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"
Nov 02 20:46:30.324772 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.324282    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd"} err="failed to get container status \"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd\": rpc error: code = NotFound desc = could not find container \"6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd\": container with ID starting with 6b69dcaef8dc5a383ef0ffe7195c4b293b7820f51a1154672677b4dba64b6efd not found: ID does not exist"
Nov 02 20:46:30.324772 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.324306    5457 scope.go:122] "RemoveContainer" containerID="8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"
Nov 02 20:46:30.336011 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.335920    5457 scope.go:122] "RemoveContainer" containerID="8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"
Nov 02 20:46:30.336297 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:30.336267    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894\": container with ID starting with 8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894 not found: ID does not exist" containerID="8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"
Nov 02 20:46:30.336344 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.336309    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894"} err="failed to get container status \"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894\": rpc error: code = NotFound desc = could not find container \"8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894\": container with ID starting with 8c94addfaa6413b8781b8dc13651ef73ecc401e7310c1b55b8c70ee0d1f07894 not found: ID does not exist"
Nov 02 20:46:30.336344 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.336334    5457 scope.go:122] "RemoveContainer" containerID="d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"
Nov 02 20:46:30.345904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.345885    5457 scope.go:122] "RemoveContainer" containerID="d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"
Nov 02 20:46:30.346199 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:30.346176    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b\": container with ID starting with d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b not found: ID does not exist" containerID="d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"
Nov 02 20:46:30.346248 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.346211    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b"} err="failed to get container status \"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b\": rpc error: code = NotFound desc = could not find container \"d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b\": container with ID starting with d8891f96d50fa1449fdfd4d9e1748a073d004357da51767b2a432bd18052082b not found: ID does not exist"
Nov 02 20:46:30.533762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.533724    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:46:30.538883 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.538852    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-tzzgc"]
Nov 02 20:46:30.638985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.638957    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:46:30.642862 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.642838    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-ll8gg"]
Nov 02 20:46:30.747266 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.747232    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:46:30.751602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:30.751578    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bce768-openshift-default-86f65b9c9f-g7nj9"]
Nov 02 20:46:31.174389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:31.174360    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" path="/var/lib/kubelet/pods/8754a7e5-161b-4b08-a5c3-0cf6124c003a/volumes"
Nov 02 20:46:31.174868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:31.174854    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" path="/var/lib/kubelet/pods/ae4744b4-2b2d-43ba-8837-4717b1c913f1/volumes"
Nov 02 20:46:31.175268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:31.175256    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c20eac7b-4a50-467b-9131-e8093629b786" path="/var/lib/kubelet/pods/c20eac7b-4a50-467b-9131-e8093629b786/volumes"
Nov 02 20:46:37.840779 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.840746    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:46:37.841247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841233    5457 cpu_manager.go:414] "containerMap: removing container" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841247    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841262    5457 cpu_manager.go:414] "containerMap: removing container" podUID="439eee24-7a80-4e98-b41b-ac41dfb9209e" containerName="payload-processing"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841268    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="439eee24-7a80-4e98-b41b-ac41dfb9209e" containerName="payload-processing"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841275    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841280    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9717e21f-d799-4275-9750-f30915590fc5" containerName="cleanup"
Nov 02 20:46:37.841289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841289    5457 cpu_manager.go:414] "containerMap: removing container" podUID="785d56fe-d51f-4b76-8f06-c524928f1340" containerName="payload-pre-processing"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841294    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="785d56fe-d51f-4b76-8f06-c524928f1340" containerName="payload-pre-processing"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841313    5457 cpu_manager.go:414] "containerMap: removing container" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841318    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841325    5457 cpu_manager.go:414] "containerMap: removing container" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841329    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d503e996-3f4d-47c3-95ed-bcd5dc304bfd" containerName="cleanup"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841341    5457 cpu_manager.go:414] "containerMap: removing container" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841345    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841352    5457 cpu_manager.go:414] "containerMap: removing container" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841356    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841362    5457 cpu_manager.go:414] "containerMap: removing container" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841367    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841435    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="785d56fe-d51f-4b76-8f06-c524928f1340" containerName="payload-pre-processing"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841443    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="8754a7e5-161b-4b08-a5c3-0cf6124c003a" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841450    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="c20eac7b-4a50-467b-9131-e8093629b786" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841456    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae4744b4-2b2d-43ba-8837-4717b1c913f1" containerName="istio-proxy"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841460    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="592cecc7-db7c-4b95-b361-17bd968ad663" containerName="cleanup"
Nov 02 20:46:37.841474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841476    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="677ad874-41aa-4846-838a-743a85cf9cfd" containerName="cleanup"
Nov 02 20:46:37.842005 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841483    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf017c6f-7385-4244-b289-80401550e98f" containerName="istio-proxy"
Nov 02 20:46:37.842005 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.841489    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="439eee24-7a80-4e98-b41b-ac41dfb9209e" containerName="payload-processing"
Nov 02 20:46:37.846325 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.846305    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:37.895019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.894993    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w6-64ff15-serving-cert\""
Nov 02 20:46:37.907576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.907537    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:37.907738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.907617    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:37.907738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.907712    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6fr\" (UniqueName: \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:37.907871 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.907773    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:37.945103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:37.945076    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:46:38.008624 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.008596    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6fr\" (UniqueName: \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.008821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.008702    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.008821 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.008791    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.008962 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:38.008828    5457 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-serving-cert: secret "maas-api-e2e-shared-b-w6-64ff15-serving-cert" not found
Nov 02 20:46:38.008962 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.008874    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.008962 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:38.008904    5457 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls podName:116591b3-7a99-4e2b-8bc2-aebe0e80e588 nodeName:}" failed. No retries permitted until 2026-11-02 20:46:38.508881462 +0000 UTC m=+1865.447270532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls") pod "maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" (UID: "116591b3-7a99-4e2b-8bc2-aebe0e80e588") : secret "maas-api-e2e-shared-b-w6-64ff15-serving-cert" not found
Nov 02 20:46:38.009487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.009458    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.011237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.011210    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.066221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.066189    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6fr\" (UniqueName: \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.518885 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.518852    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.521309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.521276    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:38.759482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:38.759451    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:39.129008 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:39.128847    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:46:39.132232 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:46:39.132198    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116591b3_7a99_4e2b_8bc2_aebe0e80e588.slice/crio-1cfde86a75c3ea19433bccb64fb70b860aecf2fb32b1ac13c162e04a7401acb7 WatchSource:0}: Error finding container 1cfde86a75c3ea19433bccb64fb70b860aecf2fb32b1ac13c162e04a7401acb7: Status 404 returned error can't find the container with id 1cfde86a75c3ea19433bccb64fb70b860aecf2fb32b1ac13c162e04a7401acb7
Nov 02 20:46:39.369913 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:39.369870    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" event={"ID":"116591b3-7a99-4e2b-8bc2-aebe0e80e588","Type":"ContainerStarted","Data":"1cfde86a75c3ea19433bccb64fb70b860aecf2fb32b1ac13c162e04a7401acb7"}
Nov 02 20:46:40.378071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:40.377974    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" event={"ID":"116591b3-7a99-4e2b-8bc2-aebe0e80e588","Type":"ContainerStarted","Data":"58f3fa170c77349322941c9fccbd69c40220a9b656c521f6be98a5d4eaa961b2"}
Nov 02 20:46:40.378071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:40.378054    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:40.489328 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:40.489280    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" podStartSLOduration=2.5232678440000003 podStartE2EDuration="3.489264286s" totalImagesPullingTime="965.996442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:46:40.487805055 +0000 UTC m=+1867.426194155" watchObservedRunningTime="2026-11-02 20:46:40.489264286 +0000 UTC m=+1867.427653348"
Nov 02 20:46:43.931658 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:43.931621    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:46:43.932145 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:43.931826    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" podUID="dea85fa8-dabc-4852-a790-23aae5ceead6" containerName="maas-api" containerID="cri-o://5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0" gracePeriod=30
Nov 02 20:46:44.299383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.299354    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:46:44.376370 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.376330    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\") pod \"dea85fa8-dabc-4852-a790-23aae5ceead6\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") "
Nov 02 20:46:44.376558 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.376390    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\") pod \"dea85fa8-dabc-4852-a790-23aae5ceead6\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") "
Nov 02 20:46:44.376558 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.376450    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\") pod \"dea85fa8-dabc-4852-a790-23aae5ceead6\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") "
Nov 02 20:46:44.376558 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.376515    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\" (UniqueName: \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\") pod \"dea85fa8-dabc-4852-a790-23aae5ceead6\" (UID: \"dea85fa8-dabc-4852-a790-23aae5ceead6\") "
Nov 02 20:46:44.376901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.376873    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca" pod "dea85fa8-dabc-4852-a790-23aae5ceead6" (UID: "dea85fa8-dabc-4852-a790-23aae5ceead6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:44.377246 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.377222    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea85fa8-dabc-4852-a790-23aae5ceead6-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:44.378670 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.378647    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs" pod "dea85fa8-dabc-4852-a790-23aae5ceead6" (UID: "dea85fa8-dabc-4852-a790-23aae5ceead6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:46:44.378804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.378776    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd" pod "dea85fa8-dabc-4852-a790-23aae5ceead6" (UID: "dea85fa8-dabc-4852-a790-23aae5ceead6"). InnerVolumeSpecName "kube-api-access-h5jqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:44.378804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.378789    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls" pod "dea85fa8-dabc-4852-a790-23aae5ceead6" (UID: "dea85fa8-dabc-4852-a790-23aae5ceead6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:46:44.492909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.492792    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:44.492909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.492846    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea85fa8-dabc-4852-a790-23aae5ceead6-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:44.492909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.492863    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5jqd\" (UniqueName: \"kubernetes.io/projected/dea85fa8-dabc-4852-a790-23aae5ceead6-kube-api-access-h5jqd\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:44.506066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.506034    5457 generic.go:356] "Generic (PLEG): container finished" podID="dea85fa8-dabc-4852-a790-23aae5ceead6" containerID="5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0" exitCode=0
Nov 02 20:46:44.506214 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.506083    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" event={"ID":"dea85fa8-dabc-4852-a790-23aae5ceead6","Type":"ContainerDied","Data":"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"}
Nov 02 20:46:44.506214 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.506136    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w" event={"ID":"dea85fa8-dabc-4852-a790-23aae5ceead6","Type":"ContainerDied","Data":"1a0b6a6f58e86227897349c15c7b99cf9d61703250664e941a2098a47729bc35"}
Nov 02 20:46:44.506214 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.506170    5457 scope.go:122] "RemoveContainer" containerID="5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"
Nov 02 20:46:44.506387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.506336    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"
Nov 02 20:46:44.535586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.535055    5457 scope.go:122] "RemoveContainer" containerID="5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"
Nov 02 20:46:44.535586 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:44.535423    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0\": container with ID starting with 5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0 not found: ID does not exist" containerID="5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"
Nov 02 20:46:44.535586 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.535470    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0"} err="failed to get container status \"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0\": rpc error: code = NotFound desc = could not find container \"5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0\": container with ID starting with 5afbf75c78b526eef48de09ebfc7a25906a94818c3de371a86785776d42a54f0 not found: ID does not exist"
Nov 02 20:46:44.663304 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.663269    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:46:44.669423 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:44.669395    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-c49693-85499595c6-gr46w"]
Nov 02 20:46:45.175064 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:45.175033    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dea85fa8-dabc-4852-a790-23aae5ceead6" path="/var/lib/kubelet/pods/dea85fa8-dabc-4852-a790-23aae5ceead6/volumes"
Nov 02 20:46:46.390075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:46.390044    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:46:53.239711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:53.238808    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:46:53.808272 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:46:53.808232    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:46:54.515615 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:54.515573    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:46:54.516157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:54.515814    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" containerID="cri-o://d9a5bd7ea39ad298cd0567b572dc6b2c8c6c6322d6e5f956e9698f6687fb25f9" gracePeriod=30
Nov 02 20:46:54.532768 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:54.532738    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:46:54.532945 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:54.532926    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy" containerID="cri-o://9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494" gracePeriod=30
Nov 02 20:46:57.192110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:57.191967    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:46:59.598041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.598011    5457 patch_prober.go:29] interesting pod/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 20:46:59.598331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.598074    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 20:46:59.631116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.631089    5457 generic.go:356] "Generic (PLEG): container finished" podID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerID="d9a5bd7ea39ad298cd0567b572dc6b2c8c6c6322d6e5f956e9698f6687fb25f9" exitCode=0
Nov 02 20:46:59.631222 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.631124    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" event={"ID":"0b61ffb6-77e1-4618-a948-4c8d19fdc95a","Type":"ContainerDied","Data":"d9a5bd7ea39ad298cd0567b572dc6b2c8c6c6322d6e5f956e9698f6687fb25f9"}
Nov 02 20:46:59.795041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.794980    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:46:59.830323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.830295    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:46:59.966168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966132    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966196    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966224    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966253    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966275    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966312    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966356 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966347    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966393    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966432    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966494    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966525    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966555    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966611    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966638    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.966698 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966665    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966711    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966787    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966800    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966828    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966845    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966924    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\") pod \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\" (UID: \"0b61ffb6-77e1-4618-a948-4c8d19fdc95a\") "
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.966965    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\") pod \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\" (UID: \"46a52ae4-1382-4f55-ba26-b3ae2b273f4f\") "
Nov 02 20:46:59.967119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967031    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:59.967525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967164    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967198    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:46:59.967525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967236    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967443    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967612    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967632    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967647    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967661    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967674    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967722    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.967748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967737    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.968114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967750    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.968114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967764    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:46:59.968114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.967976    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.969758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.969721    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:59.969876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.969818    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:46:59.969930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.969900    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:59.969985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.969967    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.970930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.970908    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:46:59.971133 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.971100    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:46:59.971513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.971490    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm" pod "46a52ae4-1382-4f55-ba26-b3ae2b273f4f" (UID: "46a52ae4-1382-4f55-ba26-b3ae2b273f4f"). InnerVolumeSpecName "kube-api-access-nbgsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:46:59.971576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:46:59.971490    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9" pod "0b61ffb6-77e1-4618-a948-4c8d19fdc95a" (UID: "0b61ffb6-77e1-4618-a948-4c8d19fdc95a"). InnerVolumeSpecName "kube-api-access-tstr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068411    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068444    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068454    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068462    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068471    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068479    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068488    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tstr9\" (UniqueName: \"kubernetes.io/projected/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-kube-api-access-tstr9\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.068494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068497    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbgsm\" (UniqueName: \"kubernetes.io/projected/46a52ae4-1382-4f55-ba26-b3ae2b273f4f-kube-api-access-nbgsm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.069104 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.068506    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b61ffb6-77e1-4618-a948-4c8d19fdc95a-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:00.638146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.638106    5457 generic.go:356] "Generic (PLEG): container finished" podID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerID="9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494" exitCode=0
Nov 02 20:47:00.638594 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.638176    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"
Nov 02 20:47:00.638594 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.638187    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" event={"ID":"46a52ae4-1382-4f55-ba26-b3ae2b273f4f","Type":"ContainerDied","Data":"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"}
Nov 02 20:47:00.638594 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.638246    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5" event={"ID":"46a52ae4-1382-4f55-ba26-b3ae2b273f4f","Type":"ContainerDied","Data":"a44a7eae0849598f9e2445d00d2ae090c6471c1ba5ab9b34a91f2f5594e0fcf4"}
Nov 02 20:47:00.638594 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.638269    5457 scope.go:122] "RemoveContainer" containerID="9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"
Nov 02 20:47:00.640235 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.640211    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj" event={"ID":"0b61ffb6-77e1-4618-a948-4c8d19fdc95a","Type":"ContainerDied","Data":"d5090f39cd941e3abd904b29f15047f870031aef2ed250dd923282d0639ea9bd"}
Nov 02 20:47:00.640367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.640232    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"
Nov 02 20:47:00.648542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.648524    5457 scope.go:122] "RemoveContainer" containerID="9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"
Nov 02 20:47:00.648911 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:00.648881    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494\": container with ID starting with 9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494 not found: ID does not exist" containerID="9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"
Nov 02 20:47:00.649000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.648923    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494"} err="failed to get container status \"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494\": rpc error: code = NotFound desc = could not find container \"9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494\": container with ID starting with 9d3cb8ff3cd3e9d77321cc13f1df34516309462522c665c535e7dc9754adf494 not found: ID does not exist"
Nov 02 20:47:00.649000 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.648948    5457 scope.go:122] "RemoveContainer" containerID="d9a5bd7ea39ad298cd0567b572dc6b2c8c6c6322d6e5f956e9698f6687fb25f9"
Nov 02 20:47:00.839081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.838994    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:47:00.885119 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.885088    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-2xmh5"]
Nov 02 20:47:00.946671 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.946639    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:47:00.950801 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:00.950773    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-c49693-openshift-default-854f8968f5-flqsj"]
Nov 02 20:47:01.173650 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:01.173620    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" path="/var/lib/kubelet/pods/0b61ffb6-77e1-4618-a948-4c8d19fdc95a/volumes"
Nov 02 20:47:01.174110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:01.174096    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" path="/var/lib/kubelet/pods/46a52ae4-1382-4f55-ba26-b3ae2b273f4f/volumes"
Nov 02 20:47:02.193660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.193597    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" podUID="35203a54-49cb-4b14-af60-c6d45223aee2" containerName="payload-pre-processing" containerID="cri-o://91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1" gracePeriod=25
Nov 02 20:47:02.458073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.458009    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:47:02.600658 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.600619    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\" (UniqueName: \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\") pod \"35203a54-49cb-4b14-af60-c6d45223aee2\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") "
Nov 02 20:47:02.600865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.600788    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\") pod \"35203a54-49cb-4b14-af60-c6d45223aee2\" (UID: \"35203a54-49cb-4b14-af60-c6d45223aee2\") "
Nov 02 20:47:02.601157 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.601133    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume" pod "35203a54-49cb-4b14-af60-c6d45223aee2" (UID: "35203a54-49cb-4b14-af60-c6d45223aee2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:47:02.601336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.601313    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35203a54-49cb-4b14-af60-c6d45223aee2-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:02.602925 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.602895    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97" pod "35203a54-49cb-4b14-af60-c6d45223aee2" (UID: "35203a54-49cb-4b14-af60-c6d45223aee2"). InnerVolumeSpecName "kube-api-access-vxl97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:02.655068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.655034    5457 generic.go:356] "Generic (PLEG): container finished" podID="35203a54-49cb-4b14-af60-c6d45223aee2" containerID="91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1" exitCode=0
Nov 02 20:47:02.655224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.655076    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"
Nov 02 20:47:02.655224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.655119    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" event={"ID":"35203a54-49cb-4b14-af60-c6d45223aee2","Type":"ContainerDied","Data":"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"}
Nov 02 20:47:02.655224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.655174    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb" event={"ID":"35203a54-49cb-4b14-af60-c6d45223aee2","Type":"ContainerDied","Data":"3eae244e6fa42738e37e519dfcaccbf2351a3cee000d21562a0ba01c2746af03"}
Nov 02 20:47:02.655224 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.655221    5457 scope.go:122] "RemoveContainer" containerID="91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"
Nov 02 20:47:02.665204 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.665178    5457 scope.go:122] "RemoveContainer" containerID="91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"
Nov 02 20:47:02.665485 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:02.665466    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1\": container with ID starting with 91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1 not found: ID does not exist" containerID="91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"
Nov 02 20:47:02.665532 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.665498    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1"} err="failed to get container status \"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1\": rpc error: code = NotFound desc = could not find container \"91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1\": container with ID starting with 91d3ac4ae64b6ea6bb3b3dd1d1fdd126e7d58c815c8df034ca6835dc6d533cb1 not found: ID does not exist"
Nov 02 20:47:02.702120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.702091    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxl97\" (UniqueName: \"kubernetes.io/projected/35203a54-49cb-4b14-af60-c6d45223aee2-kube-api-access-vxl97\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:02.810352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.810274    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:47:02.814529 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:02.814496    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0ea576-66949676c9-j2tjb"]
Nov 02 20:47:03.172822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:03.172792    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35203a54-49cb-4b14-af60-c6d45223aee2" path="/var/lib/kubelet/pods/35203a54-49cb-4b14-af60-c6d45223aee2/volumes"
Nov 02 20:47:16.537182 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:16.537099    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:47:23.808420 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:23.808370    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:47:25.063985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:25.063950    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:47:25.064417 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:25.064191    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy" containerID="cri-o://7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e" gracePeriod=30
Nov 02 20:47:30.328912 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.328885    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:47:30.482702 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482652    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.482904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482729    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.482904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482779    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.482904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482842    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.482904 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482867    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.483112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482908    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.483112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482939    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.483112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.482985    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:47:30.483112 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483017    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.483308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483113    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\") pod \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\" (UID: \"db3f4528-d3df-4f55-91b2-a378dc9dffc6\") "
Nov 02 20:47:30.483308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483212    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:47:30.483308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483249    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:47:30.483308 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483253    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:47:30.483555 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483518    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:47:30.483829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483773    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.483829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483794    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.483829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483810    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.483829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483824    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.484097 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.483838    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.485808 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.485776    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:30.486057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.486016    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:47:30.486166 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.486122    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "kube-api-access-kwdgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:30.486166 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.486153    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy" pod "db3f4528-d3df-4f55-91b2-a378dc9dffc6" (UID: "db3f4528-d3df-4f55-91b2-a378dc9dffc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:47:30.592612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.586412    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.592612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.586469    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.592612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.586486    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwdgf\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-kube-api-access-kwdgf\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.592612 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.586502    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db3f4528-d3df-4f55-91b2-a378dc9dffc6-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:30.730006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.729971    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7322-a044e6"]
Nov 02 20:47:30.730533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730512    5457 cpu_manager.go:414] "containerMap: removing container" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy"
Nov 02 20:47:30.730627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730536    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy"
Nov 02 20:47:30.730627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730557    5457 cpu_manager.go:414] "containerMap: removing container" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy"
Nov 02 20:47:30.730627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730565    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy"
Nov 02 20:47:30.730627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730601    5457 cpu_manager.go:414] "containerMap: removing container" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy"
Nov 02 20:47:30.730627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730609    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730631    5457 cpu_manager.go:414] "containerMap: removing container" podUID="dea85fa8-dabc-4852-a790-23aae5ceead6" containerName="maas-api"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730638    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dea85fa8-dabc-4852-a790-23aae5ceead6" containerName="maas-api"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730651    5457 cpu_manager.go:414] "containerMap: removing container" podUID="35203a54-49cb-4b14-af60-c6d45223aee2" containerName="payload-pre-processing"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730660    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35203a54-49cb-4b14-af60-c6d45223aee2" containerName="payload-pre-processing"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730813    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerName="istio-proxy"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730828    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b61ffb6-77e1-4618-a948-4c8d19fdc95a" containerName="istio-proxy"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730839    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="dea85fa8-dabc-4852-a790-23aae5ceead6" containerName="maas-api"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730848    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="35203a54-49cb-4b14-af60-c6d45223aee2" containerName="payload-pre-processing"
Nov 02 20:47:30.730898 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.730866    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="46a52ae4-1382-4f55-ba26-b3ae2b273f4f" containerName="istio-proxy"
Nov 02 20:47:30.734373 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.734315    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:30.789524 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.789485    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-a044e6"]
Nov 02 20:47:30.839871 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.839833    5457 generic.go:356] "Generic (PLEG): container finished" podID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" containerID="7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e" exitCode=0
Nov 02 20:47:30.840081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.839905    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"
Nov 02 20:47:30.840081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.839923    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" event={"ID":"db3f4528-d3df-4f55-91b2-a378dc9dffc6","Type":"ContainerDied","Data":"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"}
Nov 02 20:47:30.840081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.839993    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5" event={"ID":"db3f4528-d3df-4f55-91b2-a378dc9dffc6","Type":"ContainerDied","Data":"cc7d55530ac0ad1a6242557d94913af534bb4277d198a133bdcb80271dabc835"}
Nov 02 20:47:30.840081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.840023    5457 scope.go:122] "RemoveContainer" containerID="7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"
Nov 02 20:47:30.851540 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.850406    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cmjwk\""
Nov 02 20:47:30.852400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.852382    5457 scope.go:122] "RemoveContainer" containerID="7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"
Nov 02 20:47:30.852771 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:30.852751    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e\": container with ID starting with 7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e not found: ID does not exist" containerID="7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"
Nov 02 20:47:30.852819 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.852783    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e"} err="failed to get container status \"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e\": rpc error: code = NotFound desc = could not find container \"7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e\": container with ID starting with 7235eb31aacb900380d8033f139e9305e43904935442a14202a3f485d101a04e not found: ID does not exist"
Nov 02 20:47:30.889792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.889753    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fntk5\" (UniqueName: \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\") pod \"test-curl-7322-a044e6\" (UID: \"5ebdde0f-dac7-4ad0-8807-193e2b3587c1\") " pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:31.009766 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:30.995506    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fntk5\" (UniqueName: \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\") pod \"test-curl-7322-a044e6\" (UID: \"5ebdde0f-dac7-4ad0-8807-193e2b3587c1\") " pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:31.018782 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.018744    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:47:31.019440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.019411    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-nqch5"]
Nov 02 20:47:31.055372 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.055343    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fntk5\" (UniqueName: \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\") pod \"test-curl-7322-a044e6\" (UID: \"5ebdde0f-dac7-4ad0-8807-193e2b3587c1\") " pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:31.173905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.173870    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db3f4528-d3df-4f55-91b2-a378dc9dffc6" path="/var/lib/kubelet/pods/db3f4528-d3df-4f55-91b2-a378dc9dffc6/volumes"
Nov 02 20:47:31.349667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.349579    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:31.717662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.717631    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-a044e6"]
Nov 02 20:47:31.721444 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:47:31.721413    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ebdde0f_dac7_4ad0_8807_193e2b3587c1.slice/crio-7958e25fbb81c97f96bae68b2c71b75c3d12dfd606c4c63e3adab28f2a65d860 WatchSource:0}: Error finding container 7958e25fbb81c97f96bae68b2c71b75c3d12dfd606c4c63e3adab28f2a65d860: Status 404 returned error can't find the container with id 7958e25fbb81c97f96bae68b2c71b75c3d12dfd606c4c63e3adab28f2a65d860
Nov 02 20:47:31.847056 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:31.847016    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-a044e6" event={"ID":"5ebdde0f-dac7-4ad0-8807-193e2b3587c1","Type":"ContainerStarted","Data":"7958e25fbb81c97f96bae68b2c71b75c3d12dfd606c4c63e3adab28f2a65d860"}
Nov 02 20:47:32.103566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.103482    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:47:32.103757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.103719    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" podUID="38637135-b4b9-4198-bb33-68dc2502717d" containerName="maas-api" containerID="cri-o://ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4" gracePeriod=30
Nov 02 20:47:32.453855 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.453828    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:47:32.535037 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.534997    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") pod \"38637135-b4b9-4198-bb33-68dc2502717d\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") "
Nov 02 20:47:32.535252 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.535198    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\") pod \"38637135-b4b9-4198-bb33-68dc2502717d\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") "
Nov 02 20:47:32.535331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.535255    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\") pod \"38637135-b4b9-4198-bb33-68dc2502717d\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") "
Nov 02 20:47:32.535331 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.535303    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\" (UniqueName: \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\") pod \"38637135-b4b9-4198-bb33-68dc2502717d\" (UID: \"38637135-b4b9-4198-bb33-68dc2502717d\") "
Nov 02 20:47:32.535603 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.535578    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca" pod "38637135-b4b9-4198-bb33-68dc2502717d" (UID: "38637135-b4b9-4198-bb33-68dc2502717d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:47:32.537493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.537429    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs" pod "38637135-b4b9-4198-bb33-68dc2502717d" (UID: "38637135-b4b9-4198-bb33-68dc2502717d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:47:32.537493 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.537431    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5" pod "38637135-b4b9-4198-bb33-68dc2502717d" (UID: "38637135-b4b9-4198-bb33-68dc2502717d"). InnerVolumeSpecName "kube-api-access-n64b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:32.537656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.537514    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls" pod "38637135-b4b9-4198-bb33-68dc2502717d" (UID: "38637135-b4b9-4198-bb33-68dc2502717d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:47:32.638869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.638745    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n64b5\" (UniqueName: \"kubernetes.io/projected/38637135-b4b9-4198-bb33-68dc2502717d-kube-api-access-n64b5\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:32.638869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.638786    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:32.638869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.638804    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38637135-b4b9-4198-bb33-68dc2502717d-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:32.638869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.638820    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38637135-b4b9-4198-bb33-68dc2502717d-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:32.855366 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.855282    5457 generic.go:356] "Generic (PLEG): container finished" podID="38637135-b4b9-4198-bb33-68dc2502717d" containerID="ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4" exitCode=0
Nov 02 20:47:32.855366 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.855329    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"
Nov 02 20:47:32.855590 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.855362    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" event={"ID":"38637135-b4b9-4198-bb33-68dc2502717d","Type":"ContainerDied","Data":"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"}
Nov 02 20:47:32.855590 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.855416    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t" event={"ID":"38637135-b4b9-4198-bb33-68dc2502717d","Type":"ContainerDied","Data":"01a11006b3e535f7ee953335245c78076e24a7ba2ee1fdee0b8efc23d8643572"}
Nov 02 20:47:32.855590 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.855441    5457 scope.go:122] "RemoveContainer" containerID="ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"
Nov 02 20:47:32.866131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.866111    5457 scope.go:122] "RemoveContainer" containerID="ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"
Nov 02 20:47:32.866429 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:32.866408    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4\": container with ID starting with ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4 not found: ID does not exist" containerID="ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"
Nov 02 20:47:32.866473 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:32.866440    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4"} err="failed to get container status \"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4\": rpc error: code = NotFound desc = could not find container \"ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4\": container with ID starting with ce65853ad9cb8f882aa4f1fbe8a2999d300a60767f40df9d2408eb1403a0c7d4 not found: ID does not exist"
Nov 02 20:47:33.007736 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:33.007704    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:47:33.053810 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:33.053772    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-18fd4c-8fb884c5-tlf2t"]
Nov 02 20:47:33.221291 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:33.211809    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38637135-b4b9-4198-bb33-68dc2502717d" path="/var/lib/kubelet/pods/38637135-b4b9-4198-bb33-68dc2502717d/volumes"
Nov 02 20:47:37.885940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:37.885901    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-a044e6" event={"ID":"5ebdde0f-dac7-4ad0-8807-193e2b3587c1","Type":"ContainerStarted","Data":"47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496"}
Nov 02 20:47:37.992334 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:37.992277    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7322-a044e6" podStartSLOduration=2.7523119940000003 podStartE2EDuration="7.992262888s" totalImagesPullingTime="5.239950894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:47:37.990606022 +0000 UTC m=+1924.928995092" watchObservedRunningTime="2026-11-02 20:47:37.992262888 +0000 UTC m=+1924.930651956"
Nov 02 20:47:39.458321 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.458281    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7322-a044e6"]
Nov 02 20:47:39.461980 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.461948    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7322-a044e6"]
Nov 02 20:47:39.613290 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613245    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7322-8f6b5a"]
Nov 02 20:47:39.613769 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613755    5457 cpu_manager.go:414] "containerMap: removing container" podUID="38637135-b4b9-4198-bb33-68dc2502717d" containerName="maas-api"
Nov 02 20:47:39.613829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613770    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38637135-b4b9-4198-bb33-68dc2502717d" containerName="maas-api"
Nov 02 20:47:39.613829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613788    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" containerName="test-curl-7322-a044e6"
Nov 02 20:47:39.613829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613795    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" containerName="test-curl-7322-a044e6"
Nov 02 20:47:39.613924 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613897    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="38637135-b4b9-4198-bb33-68dc2502717d" containerName="maas-api"
Nov 02 20:47:39.613924 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.613904    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" containerName="test-curl-7322-a044e6"
Nov 02 20:47:39.617268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.617246    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:39.670406 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.670372    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-8f6b5a"]
Nov 02 20:47:39.722741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.722632    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpc4d\" (UniqueName: \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\") pod \"test-curl-7322-8f6b5a\" (UID: \"45817cf6-7a4d-4141-bf68-c0a9478f8c71\") " pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:39.823572 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.823528    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpc4d\" (UniqueName: \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\") pod \"test-curl-7322-8f6b5a\" (UID: \"45817cf6-7a4d-4141-bf68-c0a9478f8c71\") " pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:39.880352 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.880321    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpc4d\" (UniqueName: \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\") pod \"test-curl-7322-8f6b5a\" (UID: \"45817cf6-7a4d-4141-bf68-c0a9478f8c71\") " pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:39.896927 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.896889    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7322-a044e6" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" containerName="test-curl-7322-a044e6" containerID="cri-o://47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496" gracePeriod=2
Nov 02 20:47:39.929631 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:39.929598    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:39.944516 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:39.944462    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-a044e6\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:40.293192 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:40.293166    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-8f6b5a"]
Nov 02 20:47:40.296079 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:47:40.296045    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45817cf6_7a4d_4141_bf68_c0a9478f8c71.slice/crio-be3e6650b0a8df1080bc170be6dc101efb06d3cc8707dba144819a82e3841ace WatchSource:0}: Error finding container be3e6650b0a8df1080bc170be6dc101efb06d3cc8707dba144819a82e3841ace: Status 404 returned error can't find the container with id be3e6650b0a8df1080bc170be6dc101efb06d3cc8707dba144819a82e3841ace
Nov 02 20:47:40.903876 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:40.903838    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-8f6b5a" event={"ID":"45817cf6-7a4d-4141-bf68-c0a9478f8c71","Type":"ContainerStarted","Data":"25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3"}
Nov 02 20:47:40.904285 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:40.903886    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-8f6b5a" event={"ID":"45817cf6-7a4d-4141-bf68-c0a9478f8c71","Type":"ContainerStarted","Data":"be3e6650b0a8df1080bc170be6dc101efb06d3cc8707dba144819a82e3841ace"}
Nov 02 20:47:41.009886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:41.009829    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7322-8f6b5a" podStartSLOduration=2.00981633 podStartE2EDuration="2.00981633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:47:41.00822966 +0000 UTC m=+1927.946618729" watchObservedRunningTime="2026-11-02 20:47:41.00981633 +0000 UTC m=+1927.948205398"
Nov 02 20:47:41.066110 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:41.064749    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-a044e6\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:42.126814 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.126784    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:42.160371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.160291    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\" (UniqueName: \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\") pod \"5ebdde0f-dac7-4ad0-8807-193e2b3587c1\" (UID: \"5ebdde0f-dac7-4ad0-8807-193e2b3587c1\") "
Nov 02 20:47:42.162210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.162183    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5" pod "5ebdde0f-dac7-4ad0-8807-193e2b3587c1" (UID: "5ebdde0f-dac7-4ad0-8807-193e2b3587c1"). InnerVolumeSpecName "kube-api-access-fntk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:42.262168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.262133    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fntk5\" (UniqueName: \"kubernetes.io/projected/5ebdde0f-dac7-4ad0-8807-193e2b3587c1-kube-api-access-fntk5\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:42.475003 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.474923    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7322-8f6b5a"]
Nov 02 20:47:42.481329 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.481296    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7322-8f6b5a"]
Nov 02 20:47:42.622610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.622572    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7322-d005cf"]
Nov 02 20:47:42.623080 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.623065    5457 cpu_manager.go:414] "containerMap: removing container" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" containerName="test-curl-7322-8f6b5a"
Nov 02 20:47:42.623153 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.623080    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" containerName="test-curl-7322-8f6b5a"
Nov 02 20:47:42.623201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.623168    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" containerName="test-curl-7322-8f6b5a"
Nov 02 20:47:42.626500 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.626476    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:42.666100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.666061    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdq4\" (UniqueName: \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\") pod \"test-curl-7322-d005cf\" (UID: \"0af9942d-df86-46ee-a084-6ea812ff518e\") " pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:42.681450 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.681421    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-d005cf"]
Nov 02 20:47:42.768079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.767993    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdq4\" (UniqueName: \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\") pod \"test-curl-7322-d005cf\" (UID: \"0af9942d-df86-46ee-a084-6ea812ff518e\") " pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:42.824856 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.824829    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdq4\" (UniqueName: \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\") pod \"test-curl-7322-d005cf\" (UID: \"0af9942d-df86-46ee-a084-6ea812ff518e\") " pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:42.916577 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.916529    5457 generic.go:356] "Generic (PLEG): container finished" podID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" containerID="47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496" exitCode=137
Nov 02 20:47:42.916577 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.916579    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:42.916834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.916620    5457 scope.go:122] "RemoveContainer" containerID="47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496"
Nov 02 20:47:42.916834 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.916804    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7322-8f6b5a" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" containerName="test-curl-7322-8f6b5a" containerID="cri-o://25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3" gracePeriod=2
Nov 02 20:47:42.926141 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.926118    5457 scope.go:122] "RemoveContainer" containerID="47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496"
Nov 02 20:47:42.926448 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:42.926421    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496\": container with ID starting with 47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496 not found: ID does not exist" containerID="47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496"
Nov 02 20:47:42.926513 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.926457    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496"} err="failed to get container status \"47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496\": rpc error: code = NotFound desc = could not find container \"47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496\": container with ID starting with 47035cb272f6b062e6921323bbb485757154c1df730fb1a3df9a194beac6c496 not found: ID does not exist"
Nov 02 20:47:42.939032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:42.939007    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:42.974522 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:42.974472    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-8f6b5a\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:43.022556 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:43.022447    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-8f6b5a\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:43.069950 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:43.069908    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-a044e6\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:43.173067 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:43.173036    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" path="/var/lib/kubelet/pods/5ebdde0f-dac7-4ad0-8807-193e2b3587c1/volumes"
Nov 02 20:47:43.216280 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:43.216246    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-8f6b5a\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:43.263483 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:43.263445    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-a044e6\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5ebdde0f-dac7-4ad0-8807-193e2b3587c1" pod="opendatahub/test-curl-7322-a044e6"
Nov 02 20:47:43.345171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:43.345147    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-d005cf"]
Nov 02 20:47:43.347847 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:47:43.347814    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0af9942d_df86_46ee_a084_6ea812ff518e.slice/crio-36ec1cbfd29b3c223f34861ba98c55192c87d16db5c6544500d53f9d75c4f9ad WatchSource:0}: Error finding container 36ec1cbfd29b3c223f34861ba98c55192c87d16db5c6544500d53f9d75c4f9ad: Status 404 returned error can't find the container with id 36ec1cbfd29b3c223f34861ba98c55192c87d16db5c6544500d53f9d75c4f9ad
Nov 02 20:47:43.924585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:43.924546    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-d005cf" event={"ID":"0af9942d-df86-46ee-a084-6ea812ff518e","Type":"ContainerStarted","Data":"91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1"}
Nov 02 20:47:43.924814 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:43.924597    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-d005cf" event={"ID":"0af9942d-df86-46ee-a084-6ea812ff518e","Type":"ContainerStarted","Data":"36ec1cbfd29b3c223f34861ba98c55192c87d16db5c6544500d53f9d75c4f9ad"}
Nov 02 20:47:44.029531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:44.029471    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7322-d005cf" podStartSLOduration=2.029449844 podStartE2EDuration="2.029449844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:47:44.029371363 +0000 UTC m=+1930.967760432" watchObservedRunningTime="2026-11-02 20:47:44.029449844 +0000 UTC m=+1930.967838912"
Nov 02 20:47:45.164767 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.164740    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:45.302385 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.302291    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\" (UniqueName: \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\") pod \"45817cf6-7a4d-4141-bf68-c0a9478f8c71\" (UID: \"45817cf6-7a4d-4141-bf68-c0a9478f8c71\") "
Nov 02 20:47:45.304456 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.304426    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d" pod "45817cf6-7a4d-4141-bf68-c0a9478f8c71" (UID: "45817cf6-7a4d-4141-bf68-c0a9478f8c71"). InnerVolumeSpecName "kube-api-access-jpc4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:45.403989 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.403956    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpc4d\" (UniqueName: \"kubernetes.io/projected/45817cf6-7a4d-4141-bf68-c0a9478f8c71-kube-api-access-jpc4d\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:45.405583 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.405553    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7322-d005cf"]
Nov 02 20:47:45.410258 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.410236    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7322-d005cf"]
Nov 02 20:47:45.545368 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.545331    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7322-3b2317"]
Nov 02 20:47:45.545930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.545906    5457 cpu_manager.go:414] "containerMap: removing container" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" containerName="test-curl-7322-d005cf"
Nov 02 20:47:45.545930 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.545926    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" containerName="test-curl-7322-d005cf"
Nov 02 20:47:45.546108 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.546032    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" containerName="test-curl-7322-d005cf"
Nov 02 20:47:45.549239 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.549220    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:45.604137 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.604111    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-3b2317"]
Nov 02 20:47:45.605627 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.605610    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88n8g\" (UniqueName: \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\") pod \"test-curl-7322-3b2317\" (UID: \"5cda8c7c-7568-43a9-9bdb-fce285923e0b\") " pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:45.707156 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.707115    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88n8g\" (UniqueName: \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\") pod \"test-curl-7322-3b2317\" (UID: \"5cda8c7c-7568-43a9-9bdb-fce285923e0b\") " pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:45.764050 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.764022    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88n8g\" (UniqueName: \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\") pod \"test-curl-7322-3b2317\" (UID: \"5cda8c7c-7568-43a9-9bdb-fce285923e0b\") " pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:45.860543 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.860457    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:45.938853 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.938822    5457 generic.go:356] "Generic (PLEG): container finished" podID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" containerID="25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3" exitCode=137
Nov 02 20:47:45.939043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.938871    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-8f6b5a"
Nov 02 20:47:45.939043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.938914    5457 scope.go:122] "RemoveContainer" containerID="25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3"
Nov 02 20:47:45.939043 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.938978    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7322-d005cf" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" containerName="test-curl-7322-d005cf" containerID="cri-o://91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1" gracePeriod=2
Nov 02 20:47:45.951856 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.951835    5457 scope.go:122] "RemoveContainer" containerID="25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3"
Nov 02 20:47:45.952177 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:45.952148    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3\": container with ID starting with 25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3 not found: ID does not exist" containerID="25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3"
Nov 02 20:47:45.952286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:45.952181    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3"} err="failed to get container status \"25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3\": rpc error: code = NotFound desc = could not find container \"25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3\": container with ID starting with 25a316d587a6a897d1a846c286c85402e77278de8d865a36d6d3cd93d74809f3 not found: ID does not exist"
Nov 02 20:47:45.986396 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:45.986364    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:46.033721 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:46.033656    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:46.225036 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:46.225010    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-3b2317"]
Nov 02 20:47:46.227868 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:47:46.227839    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cda8c7c_7568_43a9_9bdb_fce285923e0b.slice/crio-4b4dd4aa9db52814f3b51f796e4bf69b0b069325ec7f145916e5ba234961af4b WatchSource:0}: Error finding container 4b4dd4aa9db52814f3b51f796e4bf69b0b069325ec7f145916e5ba234961af4b: Status 404 returned error can't find the container with id 4b4dd4aa9db52814f3b51f796e4bf69b0b069325ec7f145916e5ba234961af4b
Nov 02 20:47:46.750635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:46.750599    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:47:46.796656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:46.796628    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:47:46.908763 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:46.908719    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:46.946363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:46.946322    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-3b2317" event={"ID":"5cda8c7c-7568-43a9-9bdb-fce285923e0b","Type":"ContainerStarted","Data":"c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177"}
Nov 02 20:47:46.946518 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:46.946374    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-3b2317" event={"ID":"5cda8c7c-7568-43a9-9bdb-fce285923e0b","Type":"ContainerStarted","Data":"4b4dd4aa9db52814f3b51f796e4bf69b0b069325ec7f145916e5ba234961af4b"}
Nov 02 20:47:47.063330 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:47.063240    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:47.110642 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:47.110597    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:47.173837 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:47.173805    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45817cf6-7a4d-4141-bf68-c0a9478f8c71" path="/var/lib/kubelet/pods/45817cf6-7a4d-4141-bf68-c0a9478f8c71/volumes"
Nov 02 20:47:47.216507 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:47.216459    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7322-3b2317" podStartSLOduration=2.216445634 podStartE2EDuration="2.216445634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:47:47.215347947 +0000 UTC m=+1934.153737013" watchObservedRunningTime="2026-11-02 20:47:47.216445634 +0000 UTC m=+1934.154834702"
Nov 02 20:47:48.187499 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.187474    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:48.342019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.341930    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\" (UniqueName: \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\") pod \"0af9942d-df86-46ee-a084-6ea812ff518e\" (UID: \"0af9942d-df86-46ee-a084-6ea812ff518e\") "
Nov 02 20:47:48.344075 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.344042    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4" pod "0af9942d-df86-46ee-a084-6ea812ff518e" (UID: "0af9942d-df86-46ee-a084-6ea812ff518e"). InnerVolumeSpecName "kube-api-access-zrdq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:48.443395 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.443363    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrdq4\" (UniqueName: \"kubernetes.io/projected/0af9942d-df86-46ee-a084-6ea812ff518e-kube-api-access-zrdq4\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:48.683033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.682997    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7322-3b2317"]
Nov 02 20:47:48.687526 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.687492    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7322-3b2317"]
Nov 02 20:47:48.961867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.961759    5457 generic.go:356] "Generic (PLEG): container finished" podID="0af9942d-df86-46ee-a084-6ea812ff518e" containerID="91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1" exitCode=137
Nov 02 20:47:48.962146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.962049    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7322-3b2317" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" containerName="test-curl-7322-3b2317" containerID="cri-o://c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177" gracePeriod=2
Nov 02 20:47:48.962717 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.962366    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:48.964033 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:48.963967    5457 scope.go:122] "RemoveContainer" containerID="91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1"
Nov 02 20:47:49.019591 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:49.016018    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-3b2317\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:49.022009 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:49.021986    5457 scope.go:122] "RemoveContainer" containerID="91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1"
Nov 02 20:47:49.027442 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:49.027360    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1\": container with ID starting with 91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1 not found: ID does not exist" containerID="91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1"
Nov 02 20:47:49.027442 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:49.027417    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1"} err="failed to get container status \"91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1\": rpc error: code = NotFound desc = could not find container \"91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1\": container with ID starting with 91a1bebe13ab9d2caeac9a94f85ca1ba4b75772853a376e057942cf93eccd6c1 not found: ID does not exist"
Nov 02 20:47:49.063495 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:49.063457    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-3b2317\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:49.110857 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:49.110807    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-d005cf\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" pod="opendatahub/test-curl-7322-d005cf"
Nov 02 20:47:49.160013 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:49.159956    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-3b2317\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:49.229919 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:49.226604    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0af9942d-df86-46ee-a084-6ea812ff518e" path="/var/lib/kubelet/pods/0af9942d-df86-46ee-a084-6ea812ff518e/volumes"
Nov 02 20:47:50.298752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:50.298718    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:47:51.213738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.213711    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:51.300205 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.300112    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\" (UniqueName: \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\") pod \"5cda8c7c-7568-43a9-9bdb-fce285923e0b\" (UID: \"5cda8c7c-7568-43a9-9bdb-fce285923e0b\") "
Nov 02 20:47:51.302268 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.302235    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g" pod "5cda8c7c-7568-43a9-9bdb-fce285923e0b" (UID: "5cda8c7c-7568-43a9-9bdb-fce285923e0b"). InnerVolumeSpecName "kube-api-access-88n8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:47:51.401747 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.401675    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88n8g\" (UniqueName: \"kubernetes.io/projected/5cda8c7c-7568-43a9-9bdb-fce285923e0b-kube-api-access-88n8g\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:47:51.981425 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.981388    5457 generic.go:356] "Generic (PLEG): container finished" podID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" containerID="c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177" exitCode=137
Nov 02 20:47:51.981638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.981430    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:51.981638 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.981480    5457 scope.go:122] "RemoveContainer" containerID="c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177"
Nov 02 20:47:51.990223 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.990201    5457 scope.go:122] "RemoveContainer" containerID="c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177"
Nov 02 20:47:51.990526 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:51.990507    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177\": container with ID starting with c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177 not found: ID does not exist" containerID="c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177"
Nov 02 20:47:51.990585 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:51.990535    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177"} err="failed to get container status \"c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177\": rpc error: code = NotFound desc = could not find container \"c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177\": container with ID starting with c31404687112ba28b940ca8df54e4bca9cebcbc6e9de3ccdf5df4224ff4e8177 not found: ID does not exist"
Nov 02 20:47:52.037238 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:52.037193    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-3b2317\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:53.176532 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:53.176496    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" path="/var/lib/kubelet/pods/5cda8c7c-7568-43a9-9bdb-fce285923e0b/volumes"
Nov 02 20:47:53.217425 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:53.217380    5457 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7322-3b2317\" is forbidden: User \"system:node:ip-10-0-134-201.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-201.us-west-2.compute.internal' and this object" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" pod="opendatahub/test-curl-7322-3b2317"
Nov 02 20:47:53.807610 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:47:53.807567    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:47:55.464154 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:55.464119    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:47:55.570180 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:55.570150    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:47:59.903483 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:47:59.903443    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:48:00.008905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.008869    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:48:00.468490 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.465793    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" podUID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" containerName="payload-processing" containerID="cri-o://8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9" gracePeriod=25
Nov 02 20:48:00.570858 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.570818    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" podUID="f378953d-0d2a-4a0d-a5b3-a025589084b6" containerName="payload-pre-processing" containerID="cri-o://694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8" gracePeriod=25
Nov 02 20:48:00.870289 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.870261    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:48:00.873369 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.873347    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:48:00.972602 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.972568    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\" (UniqueName: \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\") pod \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") "
Nov 02 20:48:00.973065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.972612    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\") pod \"f378953d-0d2a-4a0d-a5b3-a025589084b6\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") "
Nov 02 20:48:00.973065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.972767    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\") pod \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\" (UID: \"41c8c1a9-92cc-44df-9303-9ef20ee69d28\") "
Nov 02 20:48:00.973065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.972808    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\" (UniqueName: \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\") pod \"f378953d-0d2a-4a0d-a5b3-a025589084b6\" (UID: \"f378953d-0d2a-4a0d-a5b3-a025589084b6\") "
Nov 02 20:48:00.973065 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.973037    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume" pod "f378953d-0d2a-4a0d-a5b3-a025589084b6" (UID: "f378953d-0d2a-4a0d-a5b3-a025589084b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:00.973270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.973157    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume" pod "41c8c1a9-92cc-44df-9303-9ef20ee69d28" (UID: "41c8c1a9-92cc-44df-9303-9ef20ee69d28"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:00.973270 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.973255    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f378953d-0d2a-4a0d-a5b3-a025589084b6-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:00.973353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.973270    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8c1a9-92cc-44df-9303-9ef20ee69d28-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:00.974765 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.974731    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn" pod "41c8c1a9-92cc-44df-9303-9ef20ee69d28" (UID: "41c8c1a9-92cc-44df-9303-9ef20ee69d28"). InnerVolumeSpecName "kube-api-access-wrqqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:00.974875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:00.974841    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp" pod "f378953d-0d2a-4a0d-a5b3-a025589084b6" (UID: "f378953d-0d2a-4a0d-a5b3-a025589084b6"). InnerVolumeSpecName "kube-api-access-mdhnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:01.054371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.054285    5457 generic.go:356] "Generic (PLEG): container finished" podID="f378953d-0d2a-4a0d-a5b3-a025589084b6" containerID="694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8" exitCode=0
Nov 02 20:48:01.054371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.054357    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"
Nov 02 20:48:01.054595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.054373    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" event={"ID":"f378953d-0d2a-4a0d-a5b3-a025589084b6","Type":"ContainerDied","Data":"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"}
Nov 02 20:48:01.054595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.054469    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86" event={"ID":"f378953d-0d2a-4a0d-a5b3-a025589084b6","Type":"ContainerDied","Data":"b43fa5ee7e57e81e28586909b8882702d6c11a26545d92a6154ccfd7a16a18c9"}
Nov 02 20:48:01.054595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.054500    5457 scope.go:122] "RemoveContainer" containerID="694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"
Nov 02 20:48:01.056007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.055981    5457 generic.go:356] "Generic (PLEG): container finished" podID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" containerID="8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9" exitCode=0
Nov 02 20:48:01.056116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.056042    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"
Nov 02 20:48:01.056116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.056062    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" event={"ID":"41c8c1a9-92cc-44df-9303-9ef20ee69d28","Type":"ContainerDied","Data":"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"}
Nov 02 20:48:01.056116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.056104    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq" event={"ID":"41c8c1a9-92cc-44df-9303-9ef20ee69d28","Type":"ContainerDied","Data":"b5c2c15705404295f3edb158fddc4bec284d9aaaa447308554842f1e669a994a"}
Nov 02 20:48:01.064829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.064809    5457 scope.go:122] "RemoveContainer" containerID="694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"
Nov 02 20:48:01.066215 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:01.066186    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8\": container with ID starting with 694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8 not found: ID does not exist" containerID="694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"
Nov 02 20:48:01.066316 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.066224    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8"} err="failed to get container status \"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8\": rpc error: code = NotFound desc = could not find container \"694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8\": container with ID starting with 694c4fc6c15c82835c9e0db69ffceb5bd5c95eb07b336ca515ae3c713081a3d8 not found: ID does not exist"
Nov 02 20:48:01.066316 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.066246    5457 scope.go:122] "RemoveContainer" containerID="8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"
Nov 02 20:48:01.074109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.074082    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdhnp\" (UniqueName: \"kubernetes.io/projected/f378953d-0d2a-4a0d-a5b3-a025589084b6-kube-api-access-mdhnp\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:01.074203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.074114    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrqqn\" (UniqueName: \"kubernetes.io/projected/41c8c1a9-92cc-44df-9303-9ef20ee69d28-kube-api-access-wrqqn\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:01.077723 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.077669    5457 scope.go:122] "RemoveContainer" containerID="8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"
Nov 02 20:48:01.078053 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:01.078034    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9\": container with ID starting with 8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9 not found: ID does not exist" containerID="8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"
Nov 02 20:48:01.078116 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.078061    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9"} err="failed to get container status \"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9\": rpc error: code = NotFound desc = could not find container \"8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9\": container with ID starting with 8e45923fa4d98915131989d20cfce45a2e58be209118dcd2dc521c9a8e2fdca9 not found: ID does not exist"
Nov 02 20:48:01.190215 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.190179    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:48:01.194437 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.194406    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-1620dc-559cdc74c5-42q86"]
Nov 02 20:48:01.295203 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.295170    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:48:01.299622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.299593    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-1620dc-65cdbdb4d8-8r7nq"]
Nov 02 20:48:01.770953 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.770915    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main" containerID="cri-o://6a3bc29f8d4b2c7d84f19d448c3d50d4dffda46a5986b408959b899a0a02a278" gracePeriod=45
Nov 02 20:48:01.815720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:01.815675    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" containerID="cri-o://2af94c6192c3e5555897f0eb352429987c20dc17e8bbd5c6c588d876b24edc81" gracePeriod=45
Nov 02 20:48:02.079201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.079077    5457 generic.go:356] "Generic (PLEG): container finished" podID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerID="6a3bc29f8d4b2c7d84f19d448c3d50d4dffda46a5986b408959b899a0a02a278" exitCode=0
Nov 02 20:48:02.079201 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.079161    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" event={"ID":"23168022-acbf-40b3-b607-53d13f9e1a5f","Type":"ContainerDied","Data":"6a3bc29f8d4b2c7d84f19d448c3d50d4dffda46a5986b408959b899a0a02a278"}
Nov 02 20:48:02.081300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.081175    5457 generic.go:356] "Generic (PLEG): container finished" podID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerID="2af94c6192c3e5555897f0eb352429987c20dc17e8bbd5c6c588d876b24edc81" exitCode=0
Nov 02 20:48:02.081300 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.081252    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" event={"ID":"72855b47-f229-4ec7-8bd8-c66ad4c68783","Type":"ContainerDied","Data":"2af94c6192c3e5555897f0eb352429987c20dc17e8bbd5c6c588d876b24edc81"}
Nov 02 20:48:02.099434 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.099411    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:48:02.121886 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.121864    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:48:02.203464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203423    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203473    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203522    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203564    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203589    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203618    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\" (UniqueName: \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.203665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203646    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\" (UniqueName: \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203674    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203761    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203774    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203782    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203870    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203895    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\" (UniqueName: \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203915    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.203934    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\" (UniqueName: \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\") pod \"23168022-acbf-40b3-b607-53d13f9e1a5f\" (UID: \"23168022-acbf-40b3-b607-53d13f9e1a5f\") "
Nov 02 20:48:02.204014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204012    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\") pod \"72855b47-f229-4ec7-8bd8-c66ad4c68783\" (UID: \"72855b47-f229-4ec7-8bd8-c66ad4c68783\") "
Nov 02 20:48:02.204421 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204241    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204485 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204463    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.204539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204513    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.204539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204532    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.204639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204546    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.204639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204561    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.204639 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.204575    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.206520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206488    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.206520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206494    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "kube-api-access-bzszl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:02.206520 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206515    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs" pod "72855b47-f229-4ec7-8bd8-c66ad4c68783" (UID: "72855b47-f229-4ec7-8bd8-c66ad4c68783"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:02.206735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206583    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:02.206735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206600    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "kube-api-access-82hl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:02.206735 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.206664    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm" pod "23168022-acbf-40b3-b607-53d13f9e1a5f" (UID: "23168022-acbf-40b3-b607-53d13f9e1a5f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:02.306001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.305958    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306001 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.305994    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82hl7\" (UniqueName: \"kubernetes.io/projected/23168022-acbf-40b3-b607-53d13f9e1a5f-kube-api-access-82hl7\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.306008    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72855b47-f229-4ec7-8bd8-c66ad4c68783-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.306022    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23168022-acbf-40b3-b607-53d13f9e1a5f-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.306035    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzszl\" (UniqueName: \"kubernetes.io/projected/72855b47-f229-4ec7-8bd8-c66ad4c68783-kube-api-access-bzszl\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.306046    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23168022-acbf-40b3-b607-53d13f9e1a5f-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:02.306211 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:02.306057    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72855b47-f229-4ec7-8bd8-c66ad4c68783-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:03.059879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.059833    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 20:48:03.089066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.089025    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"
Nov 02 20:48:03.089066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.089039    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9" event={"ID":"23168022-acbf-40b3-b607-53d13f9e1a5f","Type":"ContainerDied","Data":"9f8efa9955a4e7ab3016723316e14270f3bf66c8a9a7af1500b8a8fda238d598"}
Nov 02 20:48:03.089605 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.089096    5457 scope.go:122] "RemoveContainer" containerID="6a3bc29f8d4b2c7d84f19d448c3d50d4dffda46a5986b408959b899a0a02a278"
Nov 02 20:48:03.090476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.090456    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj" event={"ID":"72855b47-f229-4ec7-8bd8-c66ad4c68783","Type":"ContainerDied","Data":"5c0fe1ce120c3bed3f45e3bfe88c197960b34294c8cf0c3616ef6943ea2eaaf5"}
Nov 02 20:48:03.090533 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.090475    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"
Nov 02 20:48:03.099440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.099419    5457 scope.go:122] "RemoveContainer" containerID="2af94c6192c3e5555897f0eb352429987c20dc17e8bbd5c6c588d876b24edc81"
Nov 02 20:48:03.172363 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.172333    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" path="/var/lib/kubelet/pods/41c8c1a9-92cc-44df-9303-9ef20ee69d28/volumes"
Nov 02 20:48:03.172740 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.172726    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f378953d-0d2a-4a0d-a5b3-a025589084b6" path="/var/lib/kubelet/pods/f378953d-0d2a-4a0d-a5b3-a025589084b6/volumes"
Nov 02 20:48:03.241655 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.241618    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:48:03.245699 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.245658    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/distinct-w0-30ee89-kserve-6d4f765475-lblc9"]
Nov 02 20:48:03.303348 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.303315    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:48:03.313449 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.313362    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:48:03.347607 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.347570    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:48:03.350376 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:03.350342    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-30ee89/simulator-w0-30ee89-kserve-84878bdfd5-z8llj"]
Nov 02 20:48:04.904097 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:04.904047    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" podUID="27d7246d-3782-485b-b062-8e762d4f5667" containerName="payload-processing" containerID="cri-o://b1d808ad8fbebf1eff345551051dc9300eaa8c28d1981a34188e8a6204ff6eb1" gracePeriod=25
Nov 02 20:48:05.010159 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.010104    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" podUID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" containerName="payload-pre-processing" containerID="cri-o://8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27" gracePeriod=25
Nov 02 20:48:05.106171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.106127    5457 generic.go:356] "Generic (PLEG): container finished" podID="27d7246d-3782-485b-b062-8e762d4f5667" containerID="b1d808ad8fbebf1eff345551051dc9300eaa8c28d1981a34188e8a6204ff6eb1" exitCode=0
Nov 02 20:48:05.106383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.106301    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" event={"ID":"27d7246d-3782-485b-b062-8e762d4f5667","Type":"ContainerDied","Data":"b1d808ad8fbebf1eff345551051dc9300eaa8c28d1981a34188e8a6204ff6eb1"}
Nov 02 20:48:05.174032 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.173954    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" path="/var/lib/kubelet/pods/23168022-acbf-40b3-b607-53d13f9e1a5f/volumes"
Nov 02 20:48:05.174605 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.174585    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" path="/var/lib/kubelet/pods/72855b47-f229-4ec7-8bd8-c66ad4c68783/volumes"
Nov 02 20:48:05.174830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.174808    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:48:05.238893 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.238861    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\" (UniqueName: \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\") pod \"27d7246d-3782-485b-b062-8e762d4f5667\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") "
Nov 02 20:48:05.239073 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.239053    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\") pod \"27d7246d-3782-485b-b062-8e762d4f5667\" (UID: \"27d7246d-3782-485b-b062-8e762d4f5667\") "
Nov 02 20:48:05.239508 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.239462    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume" pod "27d7246d-3782-485b-b062-8e762d4f5667" (UID: "27d7246d-3782-485b-b062-8e762d4f5667"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:05.240060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.239816    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27d7246d-3782-485b-b062-8e762d4f5667-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:05.241880 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.241856    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm" pod "27d7246d-3782-485b-b062-8e762d4f5667" (UID: "27d7246d-3782-485b-b062-8e762d4f5667"). InnerVolumeSpecName "kube-api-access-btzrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:05.269566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.269544    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:48:05.341342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.341309    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\") pod \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") "
Nov 02 20:48:05.341342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.341343    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\" (UniqueName: \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\") pod \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\" (UID: \"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a\") "
Nov 02 20:48:05.341621 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.341601    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btzrm\" (UniqueName: \"kubernetes.io/projected/27d7246d-3782-485b-b062-8e762d4f5667-kube-api-access-btzrm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:05.341713 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.341671    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume" pod "7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" (UID: "7a0c64c1-4bd1-435c-b7d5-7ca9c914539a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:05.343476 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.343446    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv" pod "7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" (UID: "7a0c64c1-4bd1-435c-b7d5-7ca9c914539a"). InnerVolumeSpecName "kube-api-access-9j8jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:05.442964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.442877    5457 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-plugins-config-volume\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:05.442964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:05.442908    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j8jv\" (UniqueName: \"kubernetes.io/projected/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a-kube-api-access-9j8jv\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:06.114514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.114485    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"
Nov 02 20:48:06.114514 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.114493    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7" event={"ID":"27d7246d-3782-485b-b062-8e762d4f5667","Type":"ContainerDied","Data":"fcdb7b6fde4153c8bcf3d768e795d9eb5d5adf7e4c2bfd8a2adddf4572be8c67"}
Nov 02 20:48:06.115066 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.114563    5457 scope.go:122] "RemoveContainer" containerID="b1d808ad8fbebf1eff345551051dc9300eaa8c28d1981a34188e8a6204ff6eb1"
Nov 02 20:48:06.117074 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.117043    5457 generic.go:356] "Generic (PLEG): container finished" podID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" containerID="8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27" exitCode=0
Nov 02 20:48:06.117184 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.117123    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"
Nov 02 20:48:06.117184 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.117148    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" event={"ID":"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a","Type":"ContainerDied","Data":"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"}
Nov 02 20:48:06.117302 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.117188    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn" event={"ID":"7a0c64c1-4bd1-435c-b7d5-7ca9c914539a","Type":"ContainerDied","Data":"559a2eb6187306395d77d60d29808dae624442608089d278dee5a17ff6d10e2e"}
Nov 02 20:48:06.127828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.127657    5457 scope.go:122] "RemoveContainer" containerID="8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"
Nov 02 20:48:06.138604 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.138579    5457 scope.go:122] "RemoveContainer" containerID="8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"
Nov 02 20:48:06.138934 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:06.138914    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27\": container with ID starting with 8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27 not found: ID does not exist" containerID="8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"
Nov 02 20:48:06.139019 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.138942    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27"} err="failed to get container status \"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27\": rpc error: code = NotFound desc = could not find container \"8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27\": container with ID starting with 8841cd4429d180dc40812a897973fc25fdef9fd9e813454e4075a062947dbe27 not found: ID does not exist"
Nov 02 20:48:06.275428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.275353    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:48:06.321353 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.321318    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4166b0-6f9cdc5464-cwsg7"]
Nov 02 20:48:06.388470 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.388394    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:48:06.390789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:06.390759    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4166b0-8554c7b8f9-nwjwn"]
Nov 02 20:48:07.173441 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:07.173403    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27d7246d-3782-485b-b062-8e762d4f5667" path="/var/lib/kubelet/pods/27d7246d-3782-485b-b062-8e762d4f5667/volumes"
Nov 02 20:48:07.174129 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:07.173937    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" path="/var/lib/kubelet/pods/7a0c64c1-4bd1-435c-b7d5-7ca9c914539a/volumes"
Nov 02 20:48:18.324941 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.324883    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main" containerID="cri-o://e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5" gracePeriod=45
Nov 02 20:48:18.333444 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.333395    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main" containerID="cri-o://93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756" gracePeriod=45
Nov 02 20:48:18.602177 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.602147    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:48:18.631475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.631449    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:48:18.655763 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655739    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.655882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655810    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.655882 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655870    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.655972 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655915    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\" (UniqueName: \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.655972 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655943    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.656114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.655974    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.656114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656007    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.656114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656005    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656114 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656084    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656153    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656183    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656219    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\") pod \"bb1112e4-6778-4b20-8b2c-e4d072542275\" (UID: \"bb1112e4-6778-4b20-8b2c-e4d072542275\") "
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656245    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\" (UniqueName: \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656275    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\") pod \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\" (UID: \"8e156bc4-0902-4f18-ad4a-3443cd3126b2\") "
Nov 02 20:48:18.656323 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656314    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656394    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656628 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656576    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656743    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.656843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656816    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.656843 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656831    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.656955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656864    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.656955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656881    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.656955 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.656896    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.658475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658453    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:18.658475 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658459    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "kube-api-access-fb5ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:18.658630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658552    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:18.658630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658560    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.658998 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658975    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm" pod "bb1112e4-6778-4b20-8b2c-e4d072542275" (UID: "bb1112e4-6778-4b20-8b2c-e4d072542275"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:18.659093 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.658979    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9" pod "8e156bc4-0902-4f18-ad4a-3443cd3126b2" (UID: "8e156bc4-0902-4f18-ad4a-3443cd3126b2"). InnerVolumeSpecName "kube-api-access-zc9g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:18.758109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758074    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1112e4-6778-4b20-8b2c-e4d072542275-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758106    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc9g9\" (UniqueName: \"kubernetes.io/projected/8e156bc4-0902-4f18-ad4a-3443cd3126b2-kube-api-access-zc9g9\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758109 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758116    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758125    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1112e4-6778-4b20-8b2c-e4d072542275-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758134    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb5ls\" (UniqueName: \"kubernetes.io/projected/bb1112e4-6778-4b20-8b2c-e4d072542275-kube-api-access-fb5ls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758142    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e156bc4-0902-4f18-ad4a-3443cd3126b2-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:18.758407 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:18.758150    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e156bc4-0902-4f18-ad4a-3443cd3126b2-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:19.187804 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.187777    5457 generic.go:356] "Generic (PLEG): container finished" podID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerID="e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5" exitCode=0
Nov 02 20:48:19.187909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.187821    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"
Nov 02 20:48:19.187909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.187860    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" event={"ID":"8e156bc4-0902-4f18-ad4a-3443cd3126b2","Type":"ContainerDied","Data":"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"}
Nov 02 20:48:19.187909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.187901    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w" event={"ID":"8e156bc4-0902-4f18-ad4a-3443cd3126b2","Type":"ContainerDied","Data":"09b6da21a5308cb1acc7f709fca81cbe3b142b53fd0259436dfaf63c6cd870cc"}
Nov 02 20:48:19.188025 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.187923    5457 scope.go:122] "RemoveContainer" containerID="e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"
Nov 02 20:48:19.189355 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.189333    5457 generic.go:356] "Generic (PLEG): container finished" podID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerID="93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756" exitCode=0
Nov 02 20:48:19.189479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.189373    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"
Nov 02 20:48:19.189479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.189411    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" event={"ID":"bb1112e4-6778-4b20-8b2c-e4d072542275","Type":"ContainerDied","Data":"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"}
Nov 02 20:48:19.189479 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.189441    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds" event={"ID":"bb1112e4-6778-4b20-8b2c-e4d072542275","Type":"ContainerDied","Data":"7d58dca1366a904e92f46c67ebe7d7f96807aad09a7ef95fcec6f9b6428f6e91"}
Nov 02 20:48:19.197597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.197573    5457 scope.go:122] "RemoveContainer" containerID="e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"
Nov 02 20:48:19.197897 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:19.197867    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5\": container with ID starting with e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5 not found: ID does not exist" containerID="e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"
Nov 02 20:48:19.197963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.197906    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5"} err="failed to get container status \"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5\": rpc error: code = NotFound desc = could not find container \"e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5\": container with ID starting with e9401d5b885f810c6b922273fc1acab392c5cf7bfc2fdb055a7a615f48cfadb5 not found: ID does not exist"
Nov 02 20:48:19.197963 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.197922    5457 scope.go:122] "RemoveContainer" containerID="93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"
Nov 02 20:48:19.205752 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.205732    5457 scope.go:122] "RemoveContainer" containerID="93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"
Nov 02 20:48:19.206037 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:19.206004    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756\": container with ID starting with 93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756 not found: ID does not exist" containerID="93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"
Nov 02 20:48:19.206103 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.206039    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756"} err="failed to get container status \"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756\": rpc error: code = NotFound desc = could not find container \"93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756\": container with ID starting with 93cf9ace8040553a023001b8e660916beeac168b52db9f368fabf0080d321756 not found: ID does not exist"
Nov 02 20:48:19.339865 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.339836    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:48:19.344005 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.343980    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/premium-w1-2250b4-kserve-68cdd5b988-vg52w"]
Nov 02 20:48:19.444933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.444857    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:48:19.449282 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:19.449259    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-2250b4/simulator-w1-2250b4-kserve-7f6c84bc45-qppds"]
Nov 02 20:48:21.172541 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:21.172507    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" path="/var/lib/kubelet/pods/8e156bc4-0902-4f18-ad4a-3443cd3126b2/volumes"
Nov 02 20:48:21.172981 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:21.172970    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" path="/var/lib/kubelet/pods/bb1112e4-6778-4b20-8b2c-e4d072542275/volumes"
Nov 02 20:48:22.600656 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:22.600620    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:48:23.807535 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:23.807499    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:48:40.689528 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:40.689490    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:48:40.689968 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:40.689711    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" containerID="cri-o://2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540" gracePeriod=30
Nov 02 20:48:43.282008 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:43.281969    5457 patch_prober.go:29] interesting pod/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:48:43.282451 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:43.282033    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:48:44.084438 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.084406    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:48:44.084633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.084607    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" podUID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" containerName="maas-api" containerID="cri-o://58f3fa170c77349322941c9fccbd69c40220a9b656c521f6be98a5d4eaa961b2" gracePeriod=30
Nov 02 20:48:44.370597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.370512    5457 generic.go:356] "Generic (PLEG): container finished" podID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" containerID="58f3fa170c77349322941c9fccbd69c40220a9b656c521f6be98a5d4eaa961b2" exitCode=0
Nov 02 20:48:44.370597 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.370582    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" event={"ID":"116591b3-7a99-4e2b-8bc2-aebe0e80e588","Type":"ContainerDied","Data":"58f3fa170c77349322941c9fccbd69c40220a9b656c521f6be98a5d4eaa961b2"}
Nov 02 20:48:44.402523 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.402494    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:48:44.525383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.524329    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") pod \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") "
Nov 02 20:48:44.525383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.524410    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\" (UniqueName: \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\") pod \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") "
Nov 02 20:48:44.525383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.524492    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\") pod \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") "
Nov 02 20:48:44.525383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.524581    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\") pod \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\" (UID: \"116591b3-7a99-4e2b-8bc2-aebe0e80e588\") "
Nov 02 20:48:44.538825 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.538746    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca" pod "116591b3-7a99-4e2b-8bc2-aebe0e80e588" (UID: "116591b3-7a99-4e2b-8bc2-aebe0e80e588"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:44.550402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.547974    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs" pod "116591b3-7a99-4e2b-8bc2-aebe0e80e588" (UID: "116591b3-7a99-4e2b-8bc2-aebe0e80e588"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:44.557284 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.551083    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls" pod "116591b3-7a99-4e2b-8bc2-aebe0e80e588" (UID: "116591b3-7a99-4e2b-8bc2-aebe0e80e588"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:44.557671 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.557639    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr" pod "116591b3-7a99-4e2b-8bc2-aebe0e80e588" (UID: "116591b3-7a99-4e2b-8bc2-aebe0e80e588"). InnerVolumeSpecName "kube-api-access-hs6fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:44.625933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.625868    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:44.625933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.625895    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/116591b3-7a99-4e2b-8bc2-aebe0e80e588-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:44.625933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.625918    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs6fr\" (UniqueName: \"kubernetes.io/projected/116591b3-7a99-4e2b-8bc2-aebe0e80e588-kube-api-access-hs6fr\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:44.625933 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:44.625932    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/116591b3-7a99-4e2b-8bc2-aebe0e80e588-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:45.376637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.376602    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"
Nov 02 20:48:45.376637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.376615    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m" event={"ID":"116591b3-7a99-4e2b-8bc2-aebe0e80e588","Type":"ContainerDied","Data":"1cfde86a75c3ea19433bccb64fb70b860aecf2fb32b1ac13c162e04a7401acb7"}
Nov 02 20:48:45.377178 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.376671    5457 scope.go:122] "RemoveContainer" containerID="58f3fa170c77349322941c9fccbd69c40220a9b656c521f6be98a5d4eaa961b2"
Nov 02 20:48:45.531219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.531134    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:48:45.577500 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.577465    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-64ff15-86cb676559-2749m"]
Nov 02 20:48:45.937110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:45.937088    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:48:46.043869 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.043843    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044003 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.043925    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044003 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.043947    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044003 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.043968    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044136 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044008    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044136 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044042    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044162    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044191    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044240 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044230    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\") pod \"7f54be96-9715-4734-bde6-8792bd1faf9a\" (UID: \"7f54be96-9715-4734-bde6-8792bd1faf9a\") "
Nov 02 20:48:46.044389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044301    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:46.044389 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044348    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:46.044495 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044395    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:46.044495 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044422    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:46.044595 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044543    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:46.044789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044771    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.044874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044796    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f54be96-9715-4734-bde6-8792bd1faf9a-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.044874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044826    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.044874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044840    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.044874 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.044853    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.046581 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.046551    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:48:46.046665 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.046640    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "kube-api-access-crgpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:46.046826 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.046807    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:46.046875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.046832    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token" pod "7f54be96-9715-4734-bde6-8792bd1faf9a" (UID: "7f54be96-9715-4734-bde6-8792bd1faf9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:46.145823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.145789    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crgpl\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-kube-api-access-crgpl\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.145823 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.145818    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.146018 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.145832    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.146018 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.145845    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f54be96-9715-4734-bde6-8792bd1faf9a-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:46.382589 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.382550    5457 generic.go:356] "Generic (PLEG): container finished" podID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerID="2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540" exitCode=0
Nov 02 20:48:46.383096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.382609    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"
Nov 02 20:48:46.383096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.382629    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" event={"ID":"7f54be96-9715-4734-bde6-8792bd1faf9a","Type":"ContainerDied","Data":"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"}
Nov 02 20:48:46.383096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.382750    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t" event={"ID":"7f54be96-9715-4734-bde6-8792bd1faf9a","Type":"ContainerDied","Data":"2cb77d3b21e047620f1eff33163949e5e5f127119fd375adc40a6bad478c48a8"}
Nov 02 20:48:46.383096 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.382788    5457 scope.go:122] "RemoveContainer" containerID="2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"
Nov 02 20:48:46.392635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.392620    5457 scope.go:122] "RemoveContainer" containerID="2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"
Nov 02 20:48:46.392904 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:46.392888    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540\": container with ID starting with 2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540 not found: ID does not exist" containerID="2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"
Nov 02 20:48:46.392943 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.392912    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540"} err="failed to get container status \"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540\": rpc error: code = NotFound desc = could not find container \"2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540\": container with ID starting with 2c72ad8c2672d7cb5956f6a333dd05cf482dd526ba4044790758bdac8e133540 not found: ID does not exist"
Nov 02 20:48:46.536040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.535964    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:48:46.582102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:46.582065    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-8zj9t"]
Nov 02 20:48:47.173219 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:47.173185    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" path="/var/lib/kubelet/pods/116591b3-7a99-4e2b-8bc2-aebe0e80e588/volumes"
Nov 02 20:48:47.173633 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:47.173619    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" path="/var/lib/kubelet/pods/7f54be96-9715-4734-bde6-8792bd1faf9a/volumes"
Nov 02 20:48:51.593901 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:51.593864    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:48:51.594462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:51.594074    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" containerID="cri-o://4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c" gracePeriod=30
Nov 02 20:48:51.643635 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:51.643604    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:48:51.644146 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:51.644113    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" containerID="cri-o://2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d" gracePeriod=30
Nov 02 20:48:53.267441 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:53.267391    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:48:53.267935 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:53.267495    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:48:53.810514 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:53.808311    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:48:55.576007 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:55.575969    5457 patch_prober.go:29] interesting pod/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:48:55.576383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:55.576041    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:48:56.931260 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.931236    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:48:56.943741 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.943717    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:48:56.991979 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.991951    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992001    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992040    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992070    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992149 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992110    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992157    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992190    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992227    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992257    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992280    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992291    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992365 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992355    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992392    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992460    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992468    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992514    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992553    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992581    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992611    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992653    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\") pod \"bb49dead-b4d5-4027-bee8-16521a1f5b87\" (UID: \"bb49dead-b4d5-4027-bee8-16521a1f5b87\") "
Nov 02 20:48:56.992750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992725    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\") pod \"ae8237f4-e8a0-4094-a59d-598d1835652e\" (UID: \"ae8237f4-e8a0-4094-a59d-598d1835652e\") "
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992580    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992976    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992593    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.992636    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993134    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993056    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993237    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993256    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993273 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993271    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993287    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993302    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae8237f4-e8a0-4094-a59d-598d1835652e-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993316    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb49dead-b4d5-4027-bee8-16521a1f5b87-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993335    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993380    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993397    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:56.993759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.993440    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.995191 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995165    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.995309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995240    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:48:56.995309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995254    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:48:56.995440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995351    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "kube-api-access-cf8dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:56.995440 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995364    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "kube-api-access-rbz4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:56.995531 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995458    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:48:56.995622 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.995608    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token" pod "bb49dead-b4d5-4027-bee8-16521a1f5b87" (UID: "bb49dead-b4d5-4027-bee8-16521a1f5b87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:56.996378 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:56.996358    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token" pod "ae8237f4-e8a0-4094-a59d-598d1835652e" (UID: "ae8237f4-e8a0-4094-a59d-598d1835652e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:57.094743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094680    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbz4n\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-kube-api-access-rbz4n\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.094743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094742    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.094743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094755    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.094743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094764    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.095028 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094773    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.095028 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094788    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf8dq\" (UniqueName: \"kubernetes.io/projected/bb49dead-b4d5-4027-bee8-16521a1f5b87-kube-api-access-cf8dq\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.095028 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094800    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae8237f4-e8a0-4094-a59d-598d1835652e-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.095028 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094808    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb49dead-b4d5-4027-bee8-16521a1f5b87-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.095028 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.094818    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb49dead-b4d5-4027-bee8-16521a1f5b87-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.227727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.222449    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:48:57.227727 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.222814    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" podUID="c6b608b9-c599-47d8-8090-0e518d405c2f" containerName="maas-api" containerID="cri-o://ff70951af44c164e58fa62d276c718b5d9e91c445a9c58004cab59fb6317fdb4" gracePeriod=30
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.442964    5457 generic.go:356] "Generic (PLEG): container finished" podID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerID="4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c" exitCode=0
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.443043    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.443034    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" event={"ID":"ae8237f4-e8a0-4094-a59d-598d1835652e","Type":"ContainerDied","Data":"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"}
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.443178    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv" event={"ID":"ae8237f4-e8a0-4094-a59d-598d1835652e","Type":"ContainerDied","Data":"6fd378950d70778e6870e563b617cf8f0e78297078f1f9ac19478d904ebc678c"}
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.443220    5457 scope.go:122] "RemoveContainer" containerID="4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.446549    5457 generic.go:356] "Generic (PLEG): container finished" podID="c6b608b9-c599-47d8-8090-0e518d405c2f" containerID="ff70951af44c164e58fa62d276c718b5d9e91c445a9c58004cab59fb6317fdb4" exitCode=0
Nov 02 20:48:57.446759 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.446721    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" event={"ID":"c6b608b9-c599-47d8-8090-0e518d405c2f","Type":"ContainerDied","Data":"ff70951af44c164e58fa62d276c718b5d9e91c445a9c58004cab59fb6317fdb4"}
Nov 02 20:48:57.449402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.448448    5457 generic.go:356] "Generic (PLEG): container finished" podID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerID="2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d" exitCode=0
Nov 02 20:48:57.449402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.448495    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" event={"ID":"bb49dead-b4d5-4027-bee8-16521a1f5b87","Type":"ContainerDied","Data":"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"}
Nov 02 20:48:57.449402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.448532    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l" event={"ID":"bb49dead-b4d5-4027-bee8-16521a1f5b87","Type":"ContainerDied","Data":"763af76849ef40322dc807b14c468e7900e00a86db8d905d4d7da01191eeeebd"}
Nov 02 20:48:57.449402 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.448612    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"
Nov 02 20:48:57.455002 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.454984    5457 scope.go:122] "RemoveContainer" containerID="4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"
Nov 02 20:48:57.455275 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:57.455242    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c\": container with ID starting with 4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c not found: ID does not exist" containerID="4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"
Nov 02 20:48:57.455371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.455273    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c"} err="failed to get container status \"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c\": rpc error: code = NotFound desc = could not find container \"4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c\": container with ID starting with 4f26de285e9602cd0b4c1cfaa84061568b36e9cb9cd035f71bbfeaf19639148c not found: ID does not exist"
Nov 02 20:48:57.455371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.455289    5457 scope.go:122] "RemoveContainer" containerID="2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"
Nov 02 20:48:57.463743 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.463717    5457 scope.go:122] "RemoveContainer" containerID="2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"
Nov 02 20:48:57.464096 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:48:57.464064    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d\": container with ID starting with 2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d not found: ID does not exist" containerID="2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"
Nov 02 20:48:57.464186 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.464102    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d"} err="failed to get container status \"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d\": rpc error: code = NotFound desc = could not find container \"2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d\": container with ID starting with 2d7ac9c3b6137cec3678a11ba1a3977ad2b95f560891a3ef5e80dea10906939d not found: ID does not exist"
Nov 02 20:48:57.565397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.549033    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.609759    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.610328    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\") pod \"c6b608b9-c599-47d8-8090-0e518d405c2f\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") "
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.610471    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\" (UniqueName: \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\") pod \"c6b608b9-c599-47d8-8090-0e518d405c2f\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") "
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.610533    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") pod \"c6b608b9-c599-47d8-8090-0e518d405c2f\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") "
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.610608    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\") pod \"c6b608b9-c599-47d8-8090-0e518d405c2f\" (UID: \"c6b608b9-c599-47d8-8090-0e518d405c2f\") "
Nov 02 20:48:57.611511 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.611308    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca" pod "c6b608b9-c599-47d8-8090-0e518d405c2f" (UID: "c6b608b9-c599-47d8-8090-0e518d405c2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:48:57.617576 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.617531    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk" pod "c6b608b9-c599-47d8-8090-0e518d405c2f" (UID: "c6b608b9-c599-47d8-8090-0e518d405c2f"). InnerVolumeSpecName "kube-api-access-sdfjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:48:57.625014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.624984    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mdz2l"]
Nov 02 20:48:57.625014 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.624995    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs" pod "c6b608b9-c599-47d8-8090-0e518d405c2f" (UID: "c6b608b9-c599-47d8-8090-0e518d405c2f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:57.627646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.627232    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls" pod "c6b608b9-c599-47d8-8090-0e518d405c2f" (UID: "c6b608b9-c599-47d8-8090-0e518d405c2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:48:57.708110 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.708031    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:48:57.712584 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.712522    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-zrtzv"]
Nov 02 20:48:57.713474 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.713436    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.713643 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.713625    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdfjk\" (UniqueName: \"kubernetes.io/projected/c6b608b9-c599-47d8-8090-0e518d405c2f-kube-api-access-sdfjk\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.713829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.713810    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b608b9-c599-47d8-8090-0e518d405c2f-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:57.714013 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:57.713991    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b608b9-c599-47d8-8090-0e518d405c2f-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:48:58.456399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.456362    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2" event={"ID":"c6b608b9-c599-47d8-8090-0e518d405c2f","Type":"ContainerDied","Data":"9a8d85face07cdd9d273dc66a71fe76892079cef11b65d51493b2db68253c022"}
Nov 02 20:48:58.456399 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.456385    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"
Nov 02 20:48:58.456946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.456420    5457 scope.go:122] "RemoveContainer" containerID="ff70951af44c164e58fa62d276c718b5d9e91c445a9c58004cab59fb6317fdb4"
Nov 02 20:48:58.554410 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.554374    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:48:58.574102 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.574068    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:48:58.611309 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.611272    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:48:58.619058 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:58.619025    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-2250b4-7d465b65cf-mjqs2"]
Nov 02 20:48:59.173168 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:59.173122    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" path="/var/lib/kubelet/pods/ae8237f4-e8a0-4094-a59d-598d1835652e/volumes"
Nov 02 20:48:59.173637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:59.173622    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" path="/var/lib/kubelet/pods/bb49dead-b4d5-4027-bee8-16521a1f5b87/volumes"
Nov 02 20:48:59.174064 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:48:59.174050    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6b608b9-c599-47d8-8090-0e518d405c2f" path="/var/lib/kubelet/pods/c6b608b9-c599-47d8-8090-0e518d405c2f/volumes"
Nov 02 20:49:00.527225 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:00.527192    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:49:00.527657 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:00.527412    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy" containerID="cri-o://167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a" gracePeriod=30
Nov 02 20:49:05.786161 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.786131    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:49:05.907962 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.907927    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.907972    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908014    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908108    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908138    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908205    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908237    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908258    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908333    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908329    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:05.908397 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908360    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\") pod \"8b1964ee-b352-4221-af60-c4e16b40f880\" (UID: \"8b1964ee-b352-4221-af60-c4e16b40f880\") "
Nov 02 20:49:05.908817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908528    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:05.908817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908730    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:05.908817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908758    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:05.908817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908785    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:05.908817 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908798    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:05.909071 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.908893    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:49:05.910525 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.910501    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:05.910626 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.910603    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:49:05.910831 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.910811    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "kube-api-access-gs25p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:05.910878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:05.910855    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy" pod "8b1964ee-b352-4221-af60-c4e16b40f880" (UID: "8b1964ee-b352-4221-af60-c4e16b40f880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:06.009777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009741    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.009777 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009778    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.009978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009796    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1964ee-b352-4221-af60-c4e16b40f880-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.009978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009812    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1964ee-b352-4221-af60-c4e16b40f880-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.009978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009827    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1964ee-b352-4221-af60-c4e16b40f880-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.009978 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.009841    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs25p\" (UniqueName: \"kubernetes.io/projected/8b1964ee-b352-4221-af60-c4e16b40f880-kube-api-access-gs25p\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:06.509546 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.509514    5457 generic.go:356] "Generic (PLEG): container finished" podID="8b1964ee-b352-4221-af60-c4e16b40f880" containerID="167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a" exitCode=0
Nov 02 20:49:06.509758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.509563    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"
Nov 02 20:49:06.509758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.509594    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" event={"ID":"8b1964ee-b352-4221-af60-c4e16b40f880","Type":"ContainerDied","Data":"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"}
Nov 02 20:49:06.509758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.509644    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp" event={"ID":"8b1964ee-b352-4221-af60-c4e16b40f880","Type":"ContainerDied","Data":"7d6bee03db0f0f5bde43b8597bd3cf4d5efde946418a496397fe0c116634bce6"}
Nov 02 20:49:06.509758 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.509664    5457 scope.go:122] "RemoveContainer" containerID="167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"
Nov 02 20:49:06.519556 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.519539    5457 scope.go:122] "RemoveContainer" containerID="167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"
Nov 02 20:49:06.519819 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:06.519803    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a\": container with ID starting with 167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a not found: ID does not exist" containerID="167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"
Nov 02 20:49:06.519906 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.519826    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a"} err="failed to get container status \"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a\": rpc error: code = NotFound desc = could not find container \"167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a\": container with ID starting with 167432fe9d388555823bcc557b754545f846133650a48ae3c0b065e53d3e241a not found: ID does not exist"
Nov 02 20:49:06.662101 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.662070    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:49:06.713580 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.709969    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-30ee89-openshift-default-57474bd7b9-rk5hp"]
Nov 02 20:49:06.965866 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.965824    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:49:06.966579 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:06.966094    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy" containerID="cri-o://b9fc2e7778adc75d4581ac78ec41659b4b1a4775379fb798cf437db11c701512" gracePeriod=30
Nov 02 20:49:07.171948 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:07.171913    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" path="/var/lib/kubelet/pods/8b1964ee-b352-4221-af60-c4e16b40f880/volumes"
Nov 02 20:49:08.982570 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:08.982537    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:49:12.542994 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.542963    5457 generic.go:356] "Generic (PLEG): container finished" podID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerID="b9fc2e7778adc75d4581ac78ec41659b4b1a4775379fb798cf437db11c701512" exitCode=0
Nov 02 20:49:12.543342 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.543001    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" event={"ID":"f5bceef8-b171-4b4e-8700-55d9f56713ed","Type":"ContainerDied","Data":"b9fc2e7778adc75d4581ac78ec41659b4b1a4775379fb798cf437db11c701512"}
Nov 02 20:49:12.606135 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.606111    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:49:12.696925 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.696898    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.696933    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.696956    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.696985    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697034    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697090 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697077    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697138    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697215    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697277    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:12.697347 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697321    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\") pod \"f5bceef8-b171-4b4e-8700-55d9f56713ed\" (UID: \"f5bceef8-b171-4b4e-8700-55d9f56713ed\") "
Nov 02 20:49:12.697667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697441    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:12.697667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697529    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:12.697667 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697446    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:49:12.697868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697801    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.697868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697821    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.697868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697836    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.697868 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697850    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5bceef8-b171-4b4e-8700-55d9f56713ed-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.698018 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.697870    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:12.699267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.699239    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:49:12.699396 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.699372    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "kube-api-access-ptgb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:12.699643 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.699622    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:12.699750 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.699636    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy" pod "f5bceef8-b171-4b4e-8700-55d9f56713ed" (UID: "f5bceef8-b171-4b4e-8700-55d9f56713ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:12.804277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.799708    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.804277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.799762    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.804277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.799785    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.804277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.799799    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5bceef8-b171-4b4e-8700-55d9f56713ed-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:12.804277 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:12.799813    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptgb5\" (UniqueName: \"kubernetes.io/projected/f5bceef8-b171-4b4e-8700-55d9f56713ed-kube-api-access-ptgb5\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:13.549548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.549446    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g" event={"ID":"f5bceef8-b171-4b4e-8700-55d9f56713ed","Type":"ContainerDied","Data":"1d3d211c532235927e6e04b889e15d1129b462ae2a8eefd17c799f9cf20f92d2"}
Nov 02 20:49:13.549548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.549522    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"
Nov 02 20:49:13.549548 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.549535    5457 scope.go:122] "RemoveContainer" containerID="b9fc2e7778adc75d4581ac78ec41659b4b1a4775379fb798cf437db11c701512"
Nov 02 20:49:13.578060 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.578028    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main" containerID="cri-o://92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c" gracePeriod=45
Nov 02 20:49:13.594494 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.594466    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main" containerID="cri-o://e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69" gracePeriod=45
Nov 02 20:49:13.701909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.701886    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:49:13.747828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.747800    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-2250b4-openshift-default-6d6f4b6d7c-mbk8g"]
Nov 02 20:49:13.842229 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.842205    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:49:13.864310 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:13.864289    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:49:14.012079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012039    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012079 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012087    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\" (UniqueName: \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012135    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012158    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\" (UniqueName: \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012185    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012209    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012263    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\" (UniqueName: \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012336 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012295    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012349    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012353    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012419    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012454    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\") pod \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\" (UID: \"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de\") "
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012490    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\") pod \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\" (UID: \"10eb3e7e-e4f6-4721-83ae-3f04218ec60d\") "
Nov 02 20:49:14.012646 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012563    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.012973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012757    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.012973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012934    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.012973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012953    5457 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-home\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.012973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012967    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.012973 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.012967    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.013284 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.013166    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.013371 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.013342    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.014781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.014752    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.015608 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.015587    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:49:14.015795 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.015771    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:49:14.015873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.015795    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "kube-api-access-8bpwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:14.015873 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.015806    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl" pod "10eb3e7e-e4f6-4721-83ae-3f04218ec60d" (UID: "10eb3e7e-e4f6-4721-83ae-3f04218ec60d"). InnerVolumeSpecName "kube-api-access-qq4fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:14.015972 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.015942    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm" pod "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" (UID: "1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114341    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114369    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114380    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114391    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bpwd\" (UniqueName: \"kubernetes.io/projected/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-kube-api-access-8bpwd\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114400    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq4fl\" (UniqueName: \"kubernetes.io/projected/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-kube-api-access-qq4fl\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114410    5457 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-dshm\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114418    5457 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10eb3e7e-e4f6-4721-83ae-3f04218ec60d-tmp-dir\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114426    5457 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-model-cache\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.114757 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.114434    5457 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de-tls-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:14.555286 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.555251    5457 generic.go:356] "Generic (PLEG): container finished" podID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerID="e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69" exitCode=0
Nov 02 20:49:14.555773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.555298    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"
Nov 02 20:49:14.555773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.555337    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" event={"ID":"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de","Type":"ContainerDied","Data":"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"}
Nov 02 20:49:14.555773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.555390    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv" event={"ID":"1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de","Type":"ContainerDied","Data":"d6bc606801e23bb61a01a3e8992b3db9137159ab38360540f2041284d87549ff"}
Nov 02 20:49:14.555773 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.555412    5457 scope.go:122] "RemoveContainer" containerID="e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"
Nov 02 20:49:14.556778 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.556751    5457 generic.go:356] "Generic (PLEG): container finished" podID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerID="92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c" exitCode=0
Nov 02 20:49:14.556878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.556799    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"
Nov 02 20:49:14.556878 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.556839    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" event={"ID":"10eb3e7e-e4f6-4721-83ae-3f04218ec60d","Type":"ContainerDied","Data":"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"}
Nov 02 20:49:14.556995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.556878    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc" event={"ID":"10eb3e7e-e4f6-4721-83ae-3f04218ec60d","Type":"ContainerDied","Data":"98fd7c872f6de14f7408144888b1f0d16337557fd95e0ef4508d201ee090c46b"}
Nov 02 20:49:14.565120 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.565100    5457 scope.go:122] "RemoveContainer" containerID="e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"
Nov 02 20:49:14.565358 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:14.565337    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69\": container with ID starting with e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69 not found: ID does not exist" containerID="e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"
Nov 02 20:49:14.565427 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.565364    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69"} err="failed to get container status \"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69\": rpc error: code = NotFound desc = could not find container \"e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69\": container with ID starting with e17f59174f0723e9fe2c8a6cc09f43f0db181697db7df7974f9af8d7d13c4e69 not found: ID does not exist"
Nov 02 20:49:14.565427 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.565380    5457 scope.go:122] "RemoveContainer" containerID="92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"
Nov 02 20:49:14.572932 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.572916    5457 scope.go:122] "RemoveContainer" containerID="92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"
Nov 02 20:49:14.573200 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:14.573178    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c\": container with ID starting with 92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c not found: ID does not exist" containerID="92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"
Nov 02 20:49:14.573265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.573209    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c"} err="failed to get container status \"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c\": rpc error: code = NotFound desc = could not find container \"92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c\": container with ID starting with 92ef2a0f6f03ca87b5d719bc94aeb8d00fb2360479583f3e2fce4d4a9fb3137c not found: ID does not exist"
Nov 02 20:49:14.707041 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.707012    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:49:14.752921 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.752892    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/simulator-w6-a5cad4-kserve-86b794d487-xnrhv"]
Nov 02 20:49:14.812482 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.812410    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:49:14.818492 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:14.818469    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-a5cad4/distinct-w6-a5cad4-kserve-6ddf9474f-hcxdc"]
Nov 02 20:49:15.173126 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:15.173095    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" path="/var/lib/kubelet/pods/10eb3e7e-e4f6-4721-83ae-3f04218ec60d/volumes"
Nov 02 20:49:15.173519 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:15.173488    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" path="/var/lib/kubelet/pods/1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de/volumes"
Nov 02 20:49:15.173915 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:15.173903    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" path="/var/lib/kubelet/pods/f5bceef8-b171-4b4e-8700-55d9f56713ed/volumes"
Nov 02 20:49:23.807705 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:23.807647    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:49:29.752414 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:29.752383    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:49:39.274668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.274631    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:49:39.275131 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.274862    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" containerID="cri-o://4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2" gracePeriod=30
Nov 02 20:49:39.334614 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.334579    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:49:39.334895 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.334789    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" podUID="5657212c-2388-4486-8a01-4e628b007a53" containerName="maas-api" containerID="cri-o://e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185" gracePeriod=30
Nov 02 20:49:39.618314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.618281    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:49:39.658387 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.658358    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\" (UniqueName: \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\") pod \"5657212c-2388-4486-8a01-4e628b007a53\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") "
Nov 02 20:49:39.658522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.658403    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") pod \"5657212c-2388-4486-8a01-4e628b007a53\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") "
Nov 02 20:49:39.658522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.658480    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\") pod \"5657212c-2388-4486-8a01-4e628b007a53\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") "
Nov 02 20:49:39.658522 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.658512    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\") pod \"5657212c-2388-4486-8a01-4e628b007a53\" (UID: \"5657212c-2388-4486-8a01-4e628b007a53\") "
Nov 02 20:49:39.658909 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.658881    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca" pod "5657212c-2388-4486-8a01-4e628b007a53" (UID: "5657212c-2388-4486-8a01-4e628b007a53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:49:39.660484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.660457    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls" pod "5657212c-2388-4486-8a01-4e628b007a53" (UID: "5657212c-2388-4486-8a01-4e628b007a53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:49:39.660484 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.660470    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms" pod "5657212c-2388-4486-8a01-4e628b007a53" (UID: "5657212c-2388-4486-8a01-4e628b007a53"). InnerVolumeSpecName "kube-api-access-bl9ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:39.660603 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.660531    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs" pod "5657212c-2388-4486-8a01-4e628b007a53" (UID: "5657212c-2388-4486-8a01-4e628b007a53"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:49:39.676621 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.676598    5457 generic.go:356] "Generic (PLEG): container finished" podID="5657212c-2388-4486-8a01-4e628b007a53" containerID="e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185" exitCode=0
Nov 02 20:49:39.676738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.676644    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"
Nov 02 20:49:39.676738 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.676645    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" event={"ID":"5657212c-2388-4486-8a01-4e628b007a53","Type":"ContainerDied","Data":"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"}
Nov 02 20:49:39.676830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.676760    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6" event={"ID":"5657212c-2388-4486-8a01-4e628b007a53","Type":"ContainerDied","Data":"2da015fa0decc6553b401e6bd7220192db00273e26142928d253078b15bc9e9e"}
Nov 02 20:49:39.676830 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.676795    5457 scope.go:122] "RemoveContainer" containerID="e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"
Nov 02 20:49:39.685749 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.685727    5457 scope.go:122] "RemoveContainer" containerID="e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"
Nov 02 20:49:39.685989 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:39.685970    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185\": container with ID starting with e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185 not found: ID does not exist" containerID="e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"
Nov 02 20:49:39.686057 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.685996    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185"} err="failed to get container status \"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185\": rpc error: code = NotFound desc = could not find container \"e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185\": container with ID starting with e732a71061cf7b60b8976ff7c6f111cf7bd2d93f1df08a905ec02d8095936185 not found: ID does not exist"
Nov 02 20:49:39.760045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.760009    5457 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5657212c-2388-4486-8a01-4e628b007a53-openshift-service-ca\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:39.760045 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.760045    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:39.760537 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.760058    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl9ms\" (UniqueName: \"kubernetes.io/projected/5657212c-2388-4486-8a01-4e628b007a53-kube-api-access-bl9ms\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:39.760537 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.760071    5457 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5657212c-2388-4486-8a01-4e628b007a53-maas-api-tls\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:39.838950 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.838917    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:49:39.843712 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:39.843675    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-61cdc1-6f6bc8bb5b-75lg6"]
Nov 02 20:49:41.171875 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:41.171841    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5657212c-2388-4486-8a01-4e628b007a53" path="/var/lib/kubelet/pods/5657212c-2388-4486-8a01-4e628b007a53/volumes"
Nov 02 20:49:42.116288 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:42.116246    5457 patch_prober.go:29] interesting pod/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 20:49:42.116487 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:42.116306    5457 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 20:49:44.525613 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.525585    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:49:44.606806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606732    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.606806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606766    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.606806 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606805    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606835    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606866    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606915    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606934    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.606983    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607022    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\") pod \"ff61a5b0-370d-4b14-8284-be92dda977dc\" (UID: \"ff61a5b0-370d-4b14-8284-be92dda977dc\") "
Nov 02 20:49:44.607383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607139    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:44.607383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607219    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:44.607383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607240    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:49:44.607383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607250    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:44.607610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607447    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:44.607610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607450    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff61a5b0-370d-4b14-8284-be92dda977dc-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.607610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607491    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.607610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607510    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.607610 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.607525    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.608997 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.608967    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:49:44.609100 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.609056    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "kube-api-access-mb9xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:44.609434 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.609419    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:44.609434 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.609423    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy" pod "ff61a5b0-370d-4b14-8284-be92dda977dc" (UID: "ff61a5b0-370d-4b14-8284-be92dda977dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:44.702209 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.702178    5457 generic.go:356] "Generic (PLEG): container finished" podID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerID="4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2" exitCode=0
Nov 02 20:49:44.702367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.702245    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"
Nov 02 20:49:44.702367 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.702248    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" event={"ID":"ff61a5b0-370d-4b14-8284-be92dda977dc","Type":"ContainerDied","Data":"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"}
Nov 02 20:49:44.702448 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.702370    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2" event={"ID":"ff61a5b0-370d-4b14-8284-be92dda977dc","Type":"ContainerDied","Data":"d66062c55597788016b14c093778aee43bde444253215edecaf59d8063bb077f"}
Nov 02 20:49:44.702448 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.702393    5457 scope.go:122] "RemoveContainer" containerID="4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"
Nov 02 20:49:44.707985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.707960    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.707985 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.707984    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.708124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.707997    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.708124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.708008    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff61a5b0-370d-4b14-8284-be92dda977dc-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.708124 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.708017    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb9xg\" (UniqueName: \"kubernetes.io/projected/ff61a5b0-370d-4b14-8284-be92dda977dc-kube-api-access-mb9xg\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:44.714937 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.714913    5457 scope.go:122] "RemoveContainer" containerID="4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"
Nov 02 20:49:44.715467 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:44.715449    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2\": container with ID starting with 4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2 not found: ID does not exist" containerID="4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"
Nov 02 20:49:44.715539 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.715479    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2"} err="failed to get container status \"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2\": rpc error: code = NotFound desc = could not find container \"4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2\": container with ID starting with 4589b24081a361554d994236845e4ab1d8ca9377578443c2e00e2d4112814de2 not found: ID does not exist"
Nov 02 20:49:44.858532 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.858451    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:49:44.862210 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:44.862178    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a5cad4-openshift-default-7d6c4cd4fc-78xz2"]
Nov 02 20:49:45.172454 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:45.172425    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" path="/var/lib/kubelet/pods/ff61a5b0-370d-4b14-8284-be92dda977dc/volumes"
Nov 02 20:49:48.030965 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:48.030928    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:49:48.031468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:48.031178    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy" containerID="cri-o://c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716" gracePeriod=30
Nov 02 20:49:53.275952 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.275924    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:49:53.303722 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.303628    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-nd227"]
Nov 02 20:49:53.389789 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389751    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.389974 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389821    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.389974 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389854    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.389974 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389913    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.389974 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389943    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.390200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.389982    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.390200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390042    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.390200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390081    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.390200 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390138    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\") pod \"f9e03be6-3379-442b-a801-3f198824aa55\" (UID: \"f9e03be6-3379-442b-a801-3f198824aa55\") "
Nov 02 20:49:53.390419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390217    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:53.390419 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390338    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:53.390524 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390411    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:53.390524 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390491    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:53.390630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390541    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.390630 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390561    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.390960 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.390930    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:49:53.392669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.392636    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:49:53.392669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.392645    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "kube-api-access-ks58r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:53.392946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.392924    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:49:53.393039 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.392963    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy" pod "f9e03be6-3379-442b-a801-3f198824aa55" (UID: "f9e03be6-3379-442b-a801-3f198824aa55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:49:53.491233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491195    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491233 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491229    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491242    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e03be6-3379-442b-a801-3f198824aa55-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491256    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e03be6-3379-442b-a801-3f198824aa55-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491267    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e03be6-3379-442b-a801-3f198824aa55-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491280    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.491447 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.491293    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks58r\" (UniqueName: \"kubernetes.io/projected/f9e03be6-3379-442b-a801-3f198824aa55-kube-api-access-ks58r\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:49:53.748022 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.747990    5457 generic.go:356] "Generic (PLEG): container finished" podID="f9e03be6-3379-442b-a801-3f198824aa55" containerID="c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716" exitCode=0
Nov 02 20:49:53.748196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.748041    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"
Nov 02 20:49:53.748196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.748073    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" event={"ID":"f9e03be6-3379-442b-a801-3f198824aa55","Type":"ContainerDied","Data":"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"}
Nov 02 20:49:53.748196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.748123    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975" event={"ID":"f9e03be6-3379-442b-a801-3f198824aa55","Type":"ContainerDied","Data":"fd1d9ac7db5d307306cb21bed3bd8553fd91b3536512baf1d44ddd055b16bd91"}
Nov 02 20:49:53.748196 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.748145    5457 scope.go:122] "RemoveContainer" containerID="c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"
Nov 02 20:49:53.756867 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.756850    5457 scope.go:122] "RemoveContainer" containerID="c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"
Nov 02 20:49:53.757130 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:53.757115    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716\": container with ID starting with c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716 not found: ID does not exist" containerID="c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"
Nov 02 20:49:53.757172 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.757140    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716"} err="failed to get container status \"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716\": rpc error: code = NotFound desc = could not find container \"c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716\": container with ID starting with c88a27bb16fdddfb421b4428ff514d1190e32d16993163360a1f6daf0e29a716 not found: ID does not exist"
Nov 02 20:49:53.806892 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:49:53.806862    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:49:53.901318 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.901281    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:49:53.946915 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:53.946884    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-61cdc1-openshift-default-64d5949c5f-w9975"]
Nov 02 20:49:55.171897 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:49:55.171863    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9e03be6-3379-442b-a801-3f198824aa55" path="/var/lib/kubelet/pods/f9e03be6-3379-442b-a801-3f198824aa55/volumes"
Nov 02 20:50:03.300403 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:03.300364    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:50:03.300829 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:03.300562    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-569554b5f8-tklx4" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager" containerID="cri-o://fa8276cf5861a684318907faab9c203a20afbcb09c4e117e1941a8caf1a48a77" gracePeriod=30
Nov 02 20:50:03.792187 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:03.792150    5457 generic.go:356] "Generic (PLEG): container finished" podID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerID="fa8276cf5861a684318907faab9c203a20afbcb09c4e117e1941a8caf1a48a77" exitCode=0
Nov 02 20:50:03.792354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:03.792218    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerDied","Data":"fa8276cf5861a684318907faab9c203a20afbcb09c4e117e1941a8caf1a48a77"}
Nov 02 20:50:03.792354 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:03.792294    5457 scope.go:122] "RemoveContainer" containerID="77bd148bd983844e3f164fe8676c4346543335943231992ed48b4bd49931cc5c"
Nov 02 20:50:04.039668 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.039644    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:50:04.193165 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.193129    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\") pod \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") "
Nov 02 20:50:04.193335 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.193265    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\") pod \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") "
Nov 02 20:50:04.193415 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.193381    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\") pod \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\" (UID: \"9ca4a320-854e-40fd-9ba9-7e3f97e691d1\") "
Nov 02 20:50:04.195271 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.195244    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m" pod "9ca4a320-854e-40fd-9ba9-7e3f97e691d1" (UID: "9ca4a320-854e-40fd-9ba9-7e3f97e691d1"). InnerVolumeSpecName "kube-api-access-bdr5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:50:04.195400 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.195382    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs" pod "9ca4a320-854e-40fd-9ba9-7e3f97e691d1" (UID: "9ca4a320-854e-40fd-9ba9-7e3f97e691d1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:50:04.195462 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.195414    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert" pod "9ca4a320-854e-40fd-9ba9-7e3f97e691d1" (UID: "9ca4a320-854e-40fd-9ba9-7e3f97e691d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 20:50:04.294762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.294724    5457 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-metrics-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:50:04.294762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.294756    5457 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-webhook-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:50:04.294762 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.294768    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/9ca4a320-854e-40fd-9ba9-7e3f97e691d1-kube-api-access-bdr5m\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:50:04.798162 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.798133    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-569554b5f8-tklx4"
Nov 02 20:50:04.798607 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.798125    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-569554b5f8-tklx4" event={"ID":"9ca4a320-854e-40fd-9ba9-7e3f97e691d1","Type":"ContainerDied","Data":"05c79d566e81fe3cb44a14caa2c90374162456e8cb775f6ab88714542d688547"}
Nov 02 20:50:04.798607 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.798265    5457 scope.go:122] "RemoveContainer" containerID="fa8276cf5861a684318907faab9c203a20afbcb09c4e117e1941a8caf1a48a77"
Nov 02 20:50:04.951659 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.951623    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:50:04.997940 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:04.997905    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-569554b5f8-tklx4"]
Nov 02 20:50:05.171731 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:05.171680    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" path="/var/lib/kubelet/pods/9ca4a320-854e-40fd-9ba9-7e3f97e691d1/volumes"
Nov 02 20:50:23.807317 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:50:23.807229    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:50:33.445803 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:33.445773    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:50:33.447444 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:33.447425    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:50:41.570949 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.570912    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571230    5457 cpu_manager.go:414] "containerMap: removing container" podUID="c6b608b9-c599-47d8-8090-0e518d405c2f" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571240    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6b608b9-c599-47d8-8090-0e518d405c2f" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571250    5457 cpu_manager.go:414] "containerMap: removing container" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571255    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571262    5457 cpu_manager.go:414] "containerMap: removing container" podUID="27d7246d-3782-485b-b062-8e762d4f5667" containerName="payload-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571267    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27d7246d-3782-485b-b062-8e762d4f5667" containerName="payload-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571276    5457 cpu_manager.go:414] "containerMap: removing container" podUID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571281    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571289    5457 cpu_manager.go:414] "containerMap: removing container" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571294    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571301    5457 cpu_manager.go:414] "containerMap: removing container" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571305    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571312    5457 cpu_manager.go:414] "containerMap: removing container" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571316    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571322    5457 cpu_manager.go:414] "containerMap: removing container" podUID="f378953d-0d2a-4a0d-a5b3-a025589084b6" containerName="payload-pre-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571326    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f378953d-0d2a-4a0d-a5b3-a025589084b6" containerName="payload-pre-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571334    5457 cpu_manager.go:414] "containerMap: removing container" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571338    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571345    5457 cpu_manager.go:414] "containerMap: removing container" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571350    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571357    5457 cpu_manager.go:414] "containerMap: removing container" podUID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" containerName="payload-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571361    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" containerName="payload-processing"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571370    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5657212c-2388-4486-8a01-4e628b007a53" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571374    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5657212c-2388-4486-8a01-4e628b007a53" containerName="maas-api"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571381    5457 cpu_manager.go:414] "containerMap: removing container" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571385    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571391    5457 cpu_manager.go:414] "containerMap: removing container" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571395    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571401    5457 cpu_manager.go:414] "containerMap: removing container" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571405    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571412    5457 cpu_manager.go:414] "containerMap: removing container" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571417    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571426    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571430    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571438    5457 cpu_manager.go:414] "containerMap: removing container" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571443    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571449    5457 cpu_manager.go:414] "containerMap: removing container" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" containerName="test-curl-7322-3b2317"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571454    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" containerName="test-curl-7322-3b2317"
Nov 02 20:50:41.571443 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571461    5457 cpu_manager.go:414] "containerMap: removing container" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571465    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571471    5457 cpu_manager.go:414] "containerMap: removing container" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571475    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571481    5457 cpu_manager.go:414] "containerMap: removing container" podUID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" containerName="payload-pre-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571485    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" containerName="payload-pre-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571492    5457 cpu_manager.go:414] "containerMap: removing container" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571496    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571539    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5657212c-2388-4486-8a01-4e628b007a53" containerName="maas-api"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571547    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae8237f4-e8a0-4094-a59d-598d1835652e" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571553    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5bceef8-b171-4b4e-8700-55d9f56713ed" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571560    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb49dead-b4d5-4027-bee8-16521a1f5b87" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571565    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="23168022-acbf-40b3-b607-53d13f9e1a5f" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571570    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6b608b9-c599-47d8-8090-0e518d405c2f" containerName="maas-api"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571576    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571580    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f54be96-9715-4734-bde6-8792bd1faf9a" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571586    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb1112e4-6778-4b20-8b2c-e4d072542275" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571590    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="27d7246d-3782-485b-b062-8e762d4f5667" containerName="payload-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571594    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="116591b3-7a99-4e2b-8bc2-aebe0e80e588" containerName="maas-api"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571599    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="10eb3e7e-e4f6-4721-83ae-3f04218ec60d" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571603    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9e03be6-3379-442b-a801-3f198824aa55" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571607    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cda8c7c-7568-43a9-9bdb-fce285923e0b" containerName="test-curl-7322-3b2317"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571612    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="72855b47-f229-4ec7-8bd8-c66ad4c68783" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571617    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c09cdb4-60f0-42c8-95a2-3bf5ac55a2de" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571621    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e156bc4-0902-4f18-ad4a-3443cd3126b2" containerName="main"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571625    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a0c64c1-4bd1-435c-b7d5-7ca9c914539a" containerName="payload-pre-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571629    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff61a5b0-370d-4b14-8284-be92dda977dc" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571634    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b1964ee-b352-4221-af60-c4e16b40f880" containerName="istio-proxy"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571638    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="f378953d-0d2a-4a0d-a5b3-a025589084b6" containerName="payload-pre-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571642    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="41c8c1a9-92cc-44df-9303-9ef20ee69d28" containerName="payload-processing"
Nov 02 20:50:41.572792 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.571648    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ca4a320-854e-40fd-9ba9-7e3f97e691d1" containerName="manager"
Nov 02 20:50:41.576340 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.576321    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.672411 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.672370    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:50:41.727900 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.727868    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.727909    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.727938    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728026    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728068 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728062    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728204 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728088    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749s4\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728204 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728173    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728213    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.728265 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.728232    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829393 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829320    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829393 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829363    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829393 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829386    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829402    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829524    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829575    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-749s4\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829603    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.829677 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829660    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829732    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829821    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829889    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830006 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.829918    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830160 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.830087    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.830386 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.830369    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.831711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.831676    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.831959 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.831939    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.886669 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.886636    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.886800 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.886670    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-749s4\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\") pod \"maas-default-gateway-openshift-default-85544d4cd7-6557v\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:41.888499 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:41.888477    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:42.299206 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.299177    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:50:42.302428 ip-10-0-134-201 kubenswrapper[5457]: W1102 20:50:42.302397    5457 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a672257_96cb_4b23_9c5a_eeead78f4be9.slice/crio-85f677f938b3f268ce84af65024bd5bf8941cf61711f2bdd47d5803032cd942d WatchSource:0}: Error finding container 85f677f938b3f268ce84af65024bd5bf8941cf61711f2bdd47d5803032cd942d: Status 404 returned error can't find the container with id 85f677f938b3f268ce84af65024bd5bf8941cf61711f2bdd47d5803032cd942d
Nov 02 20:50:42.304429 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.304398    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:50:42.304491 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.304463    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:50:42.304530 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.304490    5457 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 02 20:50:42.960294 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.960256    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" event={"ID":"3a672257-96cb-4b23-9c5a-eeead78f4be9","Type":"ContainerStarted","Data":"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"}
Nov 02 20:50:42.960662 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:42.960320    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" event={"ID":"3a672257-96cb-4b23-9c5a-eeead78f4be9","Type":"ContainerStarted","Data":"85f677f938b3f268ce84af65024bd5bf8941cf61711f2bdd47d5803032cd942d"}
Nov 02 20:50:43.078699 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:43.078629    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podStartSLOduration=2.0786146580000002 podStartE2EDuration="2.078614658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 20:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 20:50:43.077327481 +0000 UTC m=+2110.015716549" watchObservedRunningTime="2026-11-02 20:50:43.078614658 +0000 UTC m=+2110.017003721"
Nov 02 20:50:43.909710 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:43.905034    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:43.913828 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:43.913795    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:43.913964 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:43.913868    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:44.908711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:44.902192    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:44.908711 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:44.902260    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:45.912890 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:45.912855    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:45.913542 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:45.913470    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:46.889725 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:46.889055    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:46.889725 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:46.889118    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:47.900141 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:47.900098    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:47.900740 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:47.900676    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:48.889486 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:48.889443    5457 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-85544d4cd7-6557v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 20:50:48.889708 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:48.889522    5457 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 20:50:50.371801 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:50.371763    5457 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:50.372512 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:50.372483    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:50.373147 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:50:50.373126    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:50:53.806591 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:50:53.806557    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:51:23.807728 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:51:23.807671    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:51:53.807739 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:51:53.807627    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:52:23.807832 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:52:23.807786    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:52:53.807365 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:52:53.807320    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:53:23.807073 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:53:23.806992    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:53:53.808374 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:53:53.808329    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:54:23.807183 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:54:23.807145    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:54:53.807473 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:54:53.807392    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:55:23.807664 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:55:23.807626    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:55:33.473081 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:33.473056    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:55:33.474786 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:33.474766    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 20:55:53.808254 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:55:53.808211    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:55:58.751507 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:58.751467    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:55:58.752082 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:58.751677    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy" containerID="cri-o://127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f" gracePeriod=30
Nov 02 20:55:58.802566 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:58.802526    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:55:58.802879 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:55:58.802834    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy" containerID="cri-o://a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893" gracePeriod=30
Nov 02 20:56:04.046836 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.046808    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:56:04.073253 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.073228    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:56:04.086468 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086443    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086581 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086487    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086581 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086533    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086703 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086580    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086703 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086619    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086703 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086650    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086678    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086752    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.086863 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086779    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\") pod \"3a672257-96cb-4b23-9c5a-eeead78f4be9\" (UID: \"3a672257-96cb-4b23-9c5a-eeead78f4be9\") "
Nov 02 20:56:04.087020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086827    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.087020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086906    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.087020 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.086996    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.087171 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.087099    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:56:04.087237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.087170    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.087237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.087179    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.087237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.087190    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.087237 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.087207    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.088748 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.088708    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.088918 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.088897    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:56:04.089016 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.088994    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "kube-api-access-749s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:04.089072 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.089028    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token" pod "3a672257-96cb-4b23-9c5a-eeead78f4be9" (UID: "3a672257-96cb-4b23-9c5a-eeead78f4be9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:04.188464 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188426    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188477    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188520    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188549    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188582    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188660 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188627    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188665    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188713    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188897    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\") pod \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\" (UID: \"92a73e54-98c9-47d1-9256-e2cb0e1cca38\") "
Nov 02 20:56:04.188966 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.188928    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.189190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189093    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.189190 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189103    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.189314 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189292    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189309    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.189379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189317    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189352    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189379 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189370    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a672257-96cb-4b23-9c5a-eeead78f4be9-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189381    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-749s4\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-kube-api-access-749s4\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189394    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a672257-96cb-4b23-9c5a-eeead78f4be9-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189408    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189425    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a672257-96cb-4b23-9c5a-eeead78f4be9-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189648 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189444    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.189946 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.189849    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:56:04.191247 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.191218    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:56:04.191345 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.191258    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:04.191345 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.191269    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:04.191345 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.191281    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw" pod "92a73e54-98c9-47d1-9256-e2cb0e1cca38" (UID: "92a73e54-98c9-47d1-9256-e2cb0e1cca38"). InnerVolumeSpecName "kube-api-access-hvstw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290570    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290605    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290618    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290631    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvstw\" (UniqueName: \"kubernetes.io/projected/92a73e54-98c9-47d1-9256-e2cb0e1cca38-kube-api-access-hvstw\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290646    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a73e54-98c9-47d1-9256-e2cb0e1cca38-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.290676 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.290658    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a73e54-98c9-47d1-9256-e2cb0e1cca38-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:04.337428 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.337386    5457 generic.go:356] "Generic (PLEG): container finished" podID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerID="127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f" exitCode=0
Nov 02 20:56:04.337637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.337468    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"
Nov 02 20:56:04.337637 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.337481    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" event={"ID":"3a672257-96cb-4b23-9c5a-eeead78f4be9","Type":"ContainerDied","Data":"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"}
Nov 02 20:56:04.337894 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.337868    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v" event={"ID":"3a672257-96cb-4b23-9c5a-eeead78f4be9","Type":"ContainerDied","Data":"85f677f938b3f268ce84af65024bd5bf8941cf61711f2bdd47d5803032cd942d"}
Nov 02 20:56:04.337995 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.337917    5457 scope.go:122] "RemoveContainer" containerID="127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"
Nov 02 20:56:04.341734 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.341709    5457 generic.go:356] "Generic (PLEG): container finished" podID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerID="a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893" exitCode=0
Nov 02 20:56:04.341808 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.341761    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"
Nov 02 20:56:04.341808 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.341780    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" event={"ID":"92a73e54-98c9-47d1-9256-e2cb0e1cca38","Type":"ContainerDied","Data":"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"}
Nov 02 20:56:04.341922 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.341826    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn" event={"ID":"92a73e54-98c9-47d1-9256-e2cb0e1cca38","Type":"ContainerDied","Data":"a83ce00447e6a888c65fd127a2f1144d4393f0c595ca7f67e53337721de5ebd4"}
Nov 02 20:56:04.349871 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.349853    5457 scope.go:122] "RemoveContainer" containerID="127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"
Nov 02 20:56:04.350223 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:56:04.350168    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f\": container with ID starting with 127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f not found: ID does not exist" containerID="127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"
Nov 02 20:56:04.350267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.350209    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f"} err="failed to get container status \"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f\": rpc error: code = NotFound desc = could not find container \"127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f\": container with ID starting with 127dbe7594f2089455e733609ec9981779e55859440dcc3f922ede03c6d1793f not found: ID does not exist"
Nov 02 20:56:04.350267 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.350235    5457 scope.go:122] "RemoveContainer" containerID="a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"
Nov 02 20:56:04.358573 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.358555    5457 scope.go:122] "RemoveContainer" containerID="a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"
Nov 02 20:56:04.358850 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:56:04.358832    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893\": container with ID starting with a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893 not found: ID does not exist" containerID="a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"
Nov 02 20:56:04.358905 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.358857    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893"} err="failed to get container status \"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893\": rpc error: code = NotFound desc = could not find container \"a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893\": container with ID starting with a215ce25ad468a0c590cfcd91a96e2aef862b6f7e993879b1835568f926f1893 not found: ID does not exist"
Nov 02 20:56:04.509236 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.509197    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:56:04.513222 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.513192    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-9kwbn"]
Nov 02 20:56:04.615221 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.615134    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:56:04.619292 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:04.619265    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-6557v"]
Nov 02 20:56:05.171699 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:05.171653    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" path="/var/lib/kubelet/pods/3a672257-96cb-4b23-9c5a-eeead78f4be9/volumes"
Nov 02 20:56:05.172111 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:05.172097    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" path="/var/lib/kubelet/pods/92a73e54-98c9-47d1-9256-e2cb0e1cca38/volumes"
Nov 02 20:56:13.867130 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:13.867051    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:56:13.867536 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:13.867315    5457 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy" containerID="cri-o://8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc" gracePeriod=30
Nov 02 20:56:19.111383 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.111351    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:56:19.224332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224243    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224291    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224332 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224314    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224336    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224369    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224389    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224592 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224559    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224594    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:19.224822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224606    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:19.224822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224618    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.224822 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224719    5457 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\") pod \"cc248393-4901-4bef-a08b-3ae4a19e6762\" (UID: \"cc248393-4901-4bef-a08b-3ae4a19e6762\") "
Nov 02 20:56:19.225040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224843    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:19.225040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224859    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:19.225040 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.224900    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 20:56:19.225185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.225086    5457 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.225185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.225107    5457 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-workload-certs\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.225185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.225120    5457 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc248393-4901-4bef-a08b-3ae4a19e6762-istiod-ca-cert\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.225185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.225133    5457 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-credential-socket\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.225185 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.225147    5457 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-data\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.226720 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.226674    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 20:56:19.226855 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.226837    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "kube-api-access-slmj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:19.227030 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.227003    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 20:56:19.227095 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.227007    5457 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy" pod "cc248393-4901-4bef-a08b-3ae4a19e6762" (UID: "cc248393-4901-4bef-a08b-3ae4a19e6762"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 20:56:19.326466 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.326428    5457 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-envoy\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.326466 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.326460    5457 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-token\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.326466 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.326471    5457 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc248393-4901-4bef-a08b-3ae4a19e6762-istio-podinfo\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.326733 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.326481    5457 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slmj9\" (UniqueName: \"kubernetes.io/projected/cc248393-4901-4bef-a08b-3ae4a19e6762-kube-api-access-slmj9\") on node \"ip-10-0-134-201.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 20:56:19.405263 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.405223    5457 generic.go:356] "Generic (PLEG): container finished" podID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerID="8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc" exitCode=0
Nov 02 20:56:19.405433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.405280    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" event={"ID":"cc248393-4901-4bef-a08b-3ae4a19e6762","Type":"ContainerDied","Data":"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"}
Nov 02 20:56:19.405433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.405319    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr" event={"ID":"cc248393-4901-4bef-a08b-3ae4a19e6762","Type":"ContainerDied","Data":"70e45f0b8170b7f88f6a061d9089a204523452200f27f86ba94e4304fceec4f7"}
Nov 02 20:56:19.405433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.405346    5457 scope.go:122] "RemoveContainer" containerID="8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"
Nov 02 20:56:19.405433 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.405282    5457 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"
Nov 02 20:56:19.414726 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.414705    5457 scope.go:122] "RemoveContainer" containerID="8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"
Nov 02 20:56:19.415014 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:56:19.414994    5457 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc\": container with ID starting with 8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc not found: ID does not exist" containerID="8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"
Nov 02 20:56:19.415084 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.415024    5457 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc"} err="failed to get container status \"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc\": rpc error: code = NotFound desc = could not find container \"8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc\": container with ID starting with 8cfa636a2b23069179fe36650e7a9bf2d4e83f4f742f9c4021ad4e7c43f980fc not found: ID does not exist"
Nov 02 20:56:19.558781 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.558672    5457 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:56:19.562381 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:19.562349    5457 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-85544d4cd7-sd8dr"]
Nov 02 20:56:21.171866 ip-10-0-134-201 kubenswrapper[5457]: I1102 20:56:21.171833    5457 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" path="/var/lib/kubelet/pods/cc248393-4901-4bef-a08b-3ae4a19e6762/volumes"
Nov 02 20:56:23.807278 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:56:23.807240    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:56:53.808511 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:56:53.808470    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:57:23.807332 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:57:23.807287    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:57:53.806388 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:57:53.806347    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:58:23.806927 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:58:23.806890    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:58:53.806575 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:58:53.806538    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:59:23.806906 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:59:23.806814    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 20:59:53.807062 ip-10-0-134-201 kubenswrapper[5457]: E1102 20:59:53.807026    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:00:23.807187 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:00:23.807154    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:00:33.497721 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:00:33.497674    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 21:00:33.500579 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:00:33.500560    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 21:00:53.807280 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:00:53.807198    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:01:23.807761 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:01:23.807721    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:01:53.807773 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:01:53.807725    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:02:23.807639 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:02:23.807554    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:02:53.807832 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:02:53.807793    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:02:55.019765 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:02:55.019737    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-6ws5j_4c73a75e-3039-4476-92a4-2878dc11c539/manager/0.log"
Nov 02 21:02:55.999635 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:02:55.999603    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-k4dr5_e415904d-5f7b-4e61-9513-c4c189ed7cd8/proxy/0.log"
Nov 02 21:02:56.821228 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:02:56.821198    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6659bff578-bmm65_f3e828b2-65ec-4bf1-8683-d1b3cc8bd050/maas-api/0.log"
Nov 02 21:02:59.584839 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:02:59.584807    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-5rpxb_5087ca73-7f57-45bc-84e8-a54ff65afa89/kuadrant-console-plugin/0.log"
Nov 02 21:03:00.639703 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:00.639650    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-nd227_6cab00ec-88da-432a-82ae-a514dde0aa99/limitador/0.log"
Nov 02 21:03:01.917895 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:01.917859    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mt9tv_0bfc5314-9d45-45ce-838c-912987af9336/discovery/0.log"
Nov 02 21:03:02.299747 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:02.299656    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-676d5b6d89-86tzj_7d1641d0-15a1-4825-a2d8-eaffa63f9a52/kube-auth-proxy/0.log"
Nov 02 21:03:17.535412 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:17.535380    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-6ws5j_4c73a75e-3039-4476-92a4-2878dc11c539/manager/0.log"
Nov 02 21:03:18.456443 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:18.456409    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-k4dr5_e415904d-5f7b-4e61-9513-c4c189ed7cd8/proxy/0.log"
Nov 02 21:03:23.806787 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:03:23.806753    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:03:30.874273 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:30.874239    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-5rpxb_5087ca73-7f57-45bc-84e8-a54ff65afa89/kuadrant-console-plugin/0.log"
Nov 02 21:03:31.542936 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:31.542908    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-nd227_6cab00ec-88da-432a-82ae-a514dde0aa99/limitador/0.log"
Nov 02 21:03:32.626873 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:32.626837    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mt9tv_0bfc5314-9d45-45ce-838c-912987af9336/discovery/0.log"
Nov 02 21:03:32.990821 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:03:32.990794    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-676d5b6d89-86tzj_7d1641d0-15a1-4825-a2d8-eaffa63f9a52/kube-auth-proxy/0.log"
Nov 02 21:03:53.807133 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:03:53.807048    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:04:23.807022 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:04:23.806986    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:04:53.807344 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:04:53.807294    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:05:20.553890 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:20.553810    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wzb8x_be869f32-baad-41a8-bc8e-85f43ad15327/global-pull-secret-syncer/0.log"
Nov 02 21:05:22.872413 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:22.872379    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mtm8t_66dfdd5f-6703-4846-bcb0-83f49098bc5f/konnectivity-agent/0.log"
Nov 02 21:05:23.632594 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:23.632557    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-201.us-west-2.compute.internal_b526d8000ee2153ea8f69907c814c3ac/haproxy/0.log"
Nov 02 21:05:23.807074 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:05:23.807028    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"
Nov 02 21:05:29.960174 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.960147    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-5rpxb_5087ca73-7f57-45bc-84e8-a54ff65afa89/kuadrant-console-plugin/0.log"
Nov 02 21:05:29.979832 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.979796    5457 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"]
Nov 02 21:05:29.980269 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980249    5457 cpu_manager.go:414] "containerMap: removing container" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy"
Nov 02 21:05:29.980326 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980272    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy"
Nov 02 21:05:29.980326 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980289    5457 cpu_manager.go:414] "containerMap: removing container" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy"
Nov 02 21:05:29.980326 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980294    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy"
Nov 02 21:05:29.980326 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980302    5457 cpu_manager.go:414] "containerMap: removing container" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy"
Nov 02 21:05:29.980326 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980307    5457 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy"
Nov 02 21:05:29.980483 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980358    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="92a73e54-98c9-47d1-9256-e2cb0e1cca38" containerName="istio-proxy"
Nov 02 21:05:29.980483 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980365    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a672257-96cb-4b23-9c5a-eeead78f4be9" containerName="istio-proxy"
Nov 02 21:05:29.980483 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.980375    5457 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc248393-4901-4bef-a08b-3ae4a19e6762" containerName="istio-proxy"
Nov 02 21:05:29.983146 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.983127    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"]
Nov 02 21:05:29.983253 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:29.983210    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.059676 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.059636    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-podres\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.059676 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.059676    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-sys\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.059934 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.059895    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-lib-modules\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.059934 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.059921    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-proc\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.060042 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.059944    5457 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lmtp\" (UniqueName: \"kubernetes.io/projected/71509695-b610-4f06-be30-899ad60c1b28-kube-api-access-6lmtp\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.099209 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.099173    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7vqs\"/\"kube-root-ca.crt\""
Nov 02 21:05:30.099371 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.099325    5457 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7vqs\"/\"openshift-service-ca.crt\""
Nov 02 21:05:30.099371 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.099335    5457 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p7vqs\"/\"default-dockercfg-rkz88\""
Nov 02 21:05:30.160931 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160895    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-lib-modules\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.160931 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160936    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-proc\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160957    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lmtp\" (UniqueName: \"kubernetes.io/projected/71509695-b610-4f06-be30-899ad60c1b28-kube-api-access-6lmtp\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160980    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-podres\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160985    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-lib-modules\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.160997    5457 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-sys\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.161049    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-sys\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.161062    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-podres\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.161142 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.161073    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71509695-b610-4f06-be30-899ad60c1b28-proc\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.229021 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.228945    5457 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lmtp\" (UniqueName: \"kubernetes.io/projected/71509695-b610-4f06-be30-899ad60c1b28-kube-api-access-6lmtp\") pod \"perf-node-gather-daemonset-wnrtv\" (UID: \"71509695-b610-4f06-be30-899ad60c1b28\") " pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.295787 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.295747    5457 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:30.668587 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.668558    5457 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"]
Nov 02 21:05:30.973424 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:30.973344    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-nd227_6cab00ec-88da-432a-82ae-a514dde0aa99/limitador/0.log"
Nov 02 21:05:31.635514 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:31.635478    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv" event={"ID":"71509695-b610-4f06-be30-899ad60c1b28","Type":"ContainerStarted","Data":"d112471d1e1a2d189859703d6f4f3d7c71c67d28fb44386cf62223f402c2b91a"}
Nov 02 21:05:31.635727 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:31.635529    5457 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv" event={"ID":"71509695-b610-4f06-be30-899ad60c1b28","Type":"ContainerStarted","Data":"61bea5a3dc4e5a8d62c50d84e560b2a5bfcb0dd0f51ef8f99318515570a6fb91"}
Nov 02 21:05:31.635727 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:31.635585    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:31.832485 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:31.832433    5457 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv" podStartSLOduration=2.832418916 podStartE2EDuration="2.832418916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:05:31.832379936 +0000 UTC m=+2998.770769006" watchObservedRunningTime="2026-11-02 21:05:31.832418916 +0000 UTC m=+2998.770807984"
Nov 02 21:05:33.523005 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:33.522968    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 21:05:33.527098 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:33.527077    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dfn5_dca97178-94dc-4858-9824-06c0c0e91c03/ovn-acl-logging/0.log"
Nov 02 21:05:33.846545 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:33.846472    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/alertmanager/0.log"
Nov 02 21:05:34.245313 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:34.245273    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/config-reloader/0.log"
Nov 02 21:05:34.640071 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:34.640045    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/kube-rbac-proxy-web/0.log"
Nov 02 21:05:35.036554 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:35.036479    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/kube-rbac-proxy/0.log"
Nov 02 21:05:35.437264 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:35.437232    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/kube-rbac-proxy-metric/0.log"
Nov 02 21:05:35.832549 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:35.832470    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/prom-label-proxy/0.log"
Nov 02 21:05:36.230578 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:36.230546    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b613443f-954c-450e-b10a-901c98f081ac/init-config-reloader/0.log"
Nov 02 21:05:37.648945 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:37.648914    5457 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p7vqs/perf-node-gather-daemonset-wnrtv"
Nov 02 21:05:38.203238 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:38.203202    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7fcf46cb44-6pxtz_5a912dbc-638d-499d-b597-b89194a13603/metrics-server/0.log"
Nov 02 21:05:41.372938 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:41.372906    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7q92_3ce01914-1334-4916-95b5-557392e76335/node-exporter/0.log"
Nov 02 21:05:41.765468 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:41.765439    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7q92_3ce01914-1334-4916-95b5-557392e76335/kube-rbac-proxy/0.log"
Nov 02 21:05:42.181914 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:42.181890    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7q92_3ce01914-1334-4916-95b5-557392e76335/init-textfile/0.log"
Nov 02 21:05:46.562561 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:46.562531    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8pbzx_3a30bcee-6023-42e4-b8e5-334a8005aa92/prometheus-operator/0.log"
Nov 02 21:05:46.952146 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:46.952112    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8pbzx_3a30bcee-6023-42e4-b8e5-334a8005aa92/kube-rbac-proxy/0.log"
Nov 02 21:05:47.744631 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:47.744601    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6768c54b48-zlltv_2df59077-df52-4e5c-a342-6eed4aa3b133/telemeter-client/0.log"
Nov 02 21:05:48.154194 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:48.154162    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6768c54b48-zlltv_2df59077-df52-4e5c-a342-6eed4aa3b133/reload/0.log"
Nov 02 21:05:48.548609 ip-10-0-134-201 kubenswrapper[5457]: I1102 21:05:48.548540    5457 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6768c54b48-zlltv_2df59077-df52-4e5c-a342-6eed4aa3b133/kube-rbac-proxy/0.log"
Nov 02 21:05:53.815495 ip-10-0-134-201 kubenswrapper[5457]: E1102 21:05:53.815453    5457 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-94wh7" containerName="extractor"